Jul 29 02:33:20.321012 ip-10-0-133-22 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 02:33:20.321033 ip-10-0-133-22 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 02:33:20.321044 ip-10-0-133-22 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 02:33:20.321422 ip-10-0-133-22 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 02:33:29.747822 ip-10-0-133-22 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 02:33:29.747836 ip-10-0-133-22 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dcbae9e1be9a4cee80611ac33c1ab1c7 --
Jul 29 02:35:00.325279 ip-10-0-133-22 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 02:35:00.680636 ip-10-0-133-22 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:00.680636 ip-10-0-133-22 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 02:35:00.680636 ip-10-0-133-22 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:00.680636 ip-10-0-133-22 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 02:35:00.680636 ip-10-0-133-22 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:00.682862 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.682768    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 02:35:00.686729 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686706    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.686729 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686726    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.686729 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686730    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.686729 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686733    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686737    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686740    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686743    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686747    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686750    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686753    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686756    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686759    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686762    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686764    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686767    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686770    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686772    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686775    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686777    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686780    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686782    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686785    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686788    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.686861 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686790    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686793    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686796    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686798    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686808    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686811    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686816    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686818    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686823    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686826    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686829    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686833    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686837    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686841    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686846    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686849    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686853    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686856    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.687350 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686858    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686862    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686865    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686867    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686870    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686873    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686876    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686879    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686881    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686884    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686886    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686889    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686892    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686894    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686910    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686913    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686916    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686919    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686921    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686924    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.687846 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686927    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686930    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686932    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686935    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686937    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686939    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686942    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686946    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686949    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686951    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686954    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686957    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686960    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686962    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686965    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686969    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686971    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686974    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686977    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686979    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.688391 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686982    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686984    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686987    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686990    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686993    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686995    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.686998    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687000    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687003    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687007    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687010    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687013    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687015    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687018    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687020    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687023    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687025    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687742    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687751    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687754    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.688882 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687758    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687762    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687765    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687767    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687771    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687774    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687776    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687780    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687784    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687786    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687789    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687792    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687795    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687798    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687800    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687803    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687805    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687808    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687810    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.689375 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687815    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687818    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687820    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687823    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687825    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687827    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687830    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687833    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687835    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687838    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687841    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687843    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687846    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687849    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687851    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687855    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687857    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687860    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687863    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687865    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.689863 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687868    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687871    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687873    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687876    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687878    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687881    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687884    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687888    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687892    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687912    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687916    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687918    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687921    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687924    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687927    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687931    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687934    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687937    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687941    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687944    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.690417 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687946    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687949    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687952    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687955    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687957    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687960    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687962    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687965    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687968    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687972    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687975    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687977    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687980    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687982    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687986    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687988    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687991    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687994    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687996    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.690919 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.687999    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688001    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688004    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688007    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688009    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688012    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688014    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688020    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688022    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688025    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688027    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688030    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688033    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688035    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688037    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688040    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688043    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688483    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688490    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.691390 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688493    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688496    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688499    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688502    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688505    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688509    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688513    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688515    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688519    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688521    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688524    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688527    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688529    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688532    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688534    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688537    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688539    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688542    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688546    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.691868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688549    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688553    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688555    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688558    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688561    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688564    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688566    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688569    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688571    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688574    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688577    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688579    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688582    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688584    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688587    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688589    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688591    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688594    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688596    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688599    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.692336 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688601    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688604    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688607    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688610    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688612    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688615    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688619    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688621    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688624    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688626    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688628    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688631    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688633    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688637    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688641    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688643    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688646    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688649    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688652    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688655    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.692825 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688657    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688661    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688664    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688666    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688669    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688671    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688674    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688676    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688679    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688681    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688684    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688686    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688689    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688691    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688693    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688696    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688699    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688701    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688704    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688707    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.693331 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688709    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688711    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688714    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688716    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688719    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688721    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688724    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688726    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688729    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688731    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688733    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688736    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688738    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688741    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688744    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688746    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688749    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.688751    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688825    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688839    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688849    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 02:35:00.693797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688855    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688861    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688866    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688872    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688878    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688881    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688884    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688889    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688893    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688907    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688912    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688915    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688918    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688921    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688924    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688929    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688932    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688935    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688938    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688942    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688945    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688949    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688952    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 02:35:00.694310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688955    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688958    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688962    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688965    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688968    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688971    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688975    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688978    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688981    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688984    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688986    2560 flags.go:64] FLAG: --enable-server="true"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688989    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688994    2560 flags.go:64] FLAG: --event-burst="100"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.688997    2560 flags.go:64] FLAG: --event-qps="50"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689000    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689004    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689007    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689012    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689015    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689018    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689021    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689024    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689026    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689029    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689035    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 02:35:00.694853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689038    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689041    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689043    2560 flags.go:64] FLAG: --feature-gates=""
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689047    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689052    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689055    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689058    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689061    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689064    2560 flags.go:64] FLAG: --help="false"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689068    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-22.ec2.internal"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689071    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689074    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689077    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689080    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689084    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689086    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689090    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689093    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689096    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689098    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689101    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689104    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689107    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689110    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 02:35:00.695516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689113    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689116    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689119    2560 flags.go:64] FLAG: --lock-file=""
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689122    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689125    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689128    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689133    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689143    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689146    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689149    2560 flags.go:64] FLAG: --logging-format="text"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689152    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689155    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689161    2560 flags.go:64] FLAG: --manifest-url=""
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689164    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689169    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689172    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689176    2560 flags.go:64] FLAG: --max-pods="110"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689179    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689182    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689185    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689188    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689191    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689194    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689197    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689205    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 02:35:00.696157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689208    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689211    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689214    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689216    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689223    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689226    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689229    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689232    2560 flags.go:64] FLAG: --port="10250"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689235    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689239    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05819c0601568650f"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689243    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689246    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689249    2560 flags.go:64] FLAG: --register-node="true"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689252    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689258    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689260    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689263    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689266    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689270    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689274    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689280    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689283    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689286    2560 flags.go:64] FLAG: --runonce="false"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689289    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689292    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 02:35:00.696796 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689295    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689298    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689301    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689304    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689307    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689310    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689313    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689316    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689318    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689321    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689324    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689328    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689331    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689336    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689338    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689341    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689345    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689349    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689352    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689354    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689357    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689361    2560 flags.go:64] FLAG: --v="2"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689365    2560 flags.go:64] FLAG: --version="false"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689369    2560 flags.go:64] FLAG: --vmodule=""
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689373    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 02:35:00.697421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.689376    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689496    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689502    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689505    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689508    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689510    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689513    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689515    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689518    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689521    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689523    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689526    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689528    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689532    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689537    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689541    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689545    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689548    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689551    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.698043 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689554    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689557    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689559    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689562    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689565    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689567    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689572    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689575    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689578    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689582    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689585    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689587    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689590    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689593    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689596    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689599    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689602    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689604    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689607    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689609    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.698498 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689612    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689615    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689617    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689619    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689622    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689625    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689627    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689629    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689632    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689634    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689637    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689639    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689642    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689644    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689647    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689649    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689652    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689654    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689657    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689662    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.699011 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689665    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689669    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689672    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689674    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689677    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689679    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689682    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689686    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689688    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689691    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689694    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689696    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689699    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689701    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689704    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689707    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689709    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689712    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689714    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689717    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.699526 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689719    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689722    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689724    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689727    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689729    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689731    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689734    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689737    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689739    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689742    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689745    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689747    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689751    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689754    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689756    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689759    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689762    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689764    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689766    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.700030 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689770    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.689772    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.690387    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.697836    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.697858    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.698568    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.698578    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698645    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698651    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698654    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698657    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698661    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698665    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698667    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698670    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.700487 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698673    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698675    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698678    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698681    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698684    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698687    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698689    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698692    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698695    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698697    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698700    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698704    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698707    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698711    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698714    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698716    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698719    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698722    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698725    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.700868 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698728    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698731    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698735    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698738    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698741    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698743    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698746    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698749    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698751    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698754    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698756    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698759    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698762    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698764    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698767    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698769    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698772    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698774    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698777    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698780    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.701344 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698782    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698785    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698787    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698790    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698792    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698795    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698797    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698800    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698803    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698805    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698808    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698810    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698814    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698816    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698819    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698823    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698825    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698828    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698831    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.701836 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698833    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698836    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698838    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698841    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698843    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698846    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698848    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698851    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698853    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698856    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698858    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698861    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698863    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698866    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698869    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698871    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698874    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698876    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698878    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698881    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698884    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.702419 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698886    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698889    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698893    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698910    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698915    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698918    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698921    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698924    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698927    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698931    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698935    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.698938    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.698944    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699068    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:00.702984 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699073    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699077    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699079    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699082    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699085    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699088    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699091    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699093    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699096    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699098    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699101    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699104    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699106    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699109    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699111    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699113    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699116    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699118    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699121    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699124    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:00.703358 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699126    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699129    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699131    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699134    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699137    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699140    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699142    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699146    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699148    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699151    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699154    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699158    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699162    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699165    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699167    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699170    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699172    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699175    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699177    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699180    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:00.703829 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699182    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699185    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699187    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699190    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699192    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699195    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699197    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699200    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699202    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699205    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699207    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699209    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699212    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699214    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699217    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699219    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699223    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699226    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699229    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:00.704356 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699232    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699236    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699240    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699242    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699245    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699248    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699250    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699253    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699255    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699258    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699260    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699263    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699265    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699268    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699272    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699275    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699278    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699280    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:00.704840 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699283    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699285    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699288    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699291    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699293    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699296    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699299    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699301    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699304    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699306    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699309    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699312    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699315    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699318    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699320    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699323    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699326    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699329    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699332    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699334    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:00.705288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:00.699337    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.699341    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.699493    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.703226    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.704611    2560 server.go:1019] "Starting client certificate rotation"
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.704717    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 02:35:00.705792 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.704761    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 02:35:00.708240 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.708169    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 02:35:00.713161 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.713130    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 02:35:00.726076 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.726053    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 29 02:35:00.729041 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.729017    2560 log.go:25] "Validated CRI v1 image API"
Jul 29 02:35:00.730338 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.730315    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 02:35:00.732621 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.732594    2560 fs.go:135] Filesystem UUIDs: map[4849d6e1-22d2-4f38-ad2c-da0196503a68:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 acba747f-9da1-4035-b154-b7f386157613:/dev/nvme0n1p4]
Jul 29 02:35:00.732621 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.732618    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 02:35:00.738513 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.738363    2560 manager.go:216] Machine: {Timestamp:2026-07-29 02:35:00.736880304 +0000 UTC m=+0.301943017 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3171233 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9161b2664817e8cf022b08321023 SystemUUID:ec2a9161-b266-4817-e8cf-022b08321023 BootID:dcbae9e1-be9a-4cee-8061-1ac33c1ab1c7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:a7:56:ab:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:a7:56:ab:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:de:22:fb:fb:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 02:35:00.738513 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.738481    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 02:35:00.738716 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.738692    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 02:35:00.739029 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.739008    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 02:35:00.741748 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.741712    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 02:35:00.741894 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.741750    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 02:35:00.742536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.742523    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 02:35:00.742536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.742537    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 02:35:00.742604 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.742545    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 02:35:00.743253 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.743239    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 02:35:00.744270 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.744256    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 02:35:00.746325 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746308    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 02:35:00.746463 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746452    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 02:35:00.746503 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746484    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 02:35:00.746537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746506    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 02:35:00.746537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746521    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 02:35:00.746537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746532    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 29 02:35:00.746636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746547    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 02:35:00.747014 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.746997    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 02:35:00.747014 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.747025    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 02:35:00.749418 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.749402    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 02:35:00.751941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.751924    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 02:35:00.751998 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.751958    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 02:35:00.753870 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753854    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 02:35:00.753870 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753873    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753880    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753885    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753895    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753915    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753927    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753932    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753939    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753944    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753959    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 02:35:00.753959 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.753965    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 02:35:00.754691 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.754679    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 02:35:00.754691 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.754691    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 02:35:00.759985 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.759958    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 02:35:00.760173 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.760129    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 02:35:00.760419 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.760399    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 02:35:00.761245 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.761230    2560 server.go:1268] "Started kubelet"
Jul 29 02:35:00.761390 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.761335    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 02:35:00.761462 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.761407    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 02:35:00.761516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.761496    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 02:35:00.762675 ip-10-0-133-22 systemd[1]: Started Kubernetes Kubelet.
Jul 29 02:35:00.763231 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.763216    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 02:35:00.763527 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.763510    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 02:35:00.767764 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.766874    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-22.ec2.internal.18c6a212100a19fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-22.ec2.internal,UID:ip-10-0-133-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-22.ec2.internal,},FirstTimestamp:2026-07-29 02:35:00.761188861 +0000 UTC m=+0.326251575,LastTimestamp:2026-07-29 02:35:00.761188861 +0000 UTC m=+0.326251575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-22.ec2.internal,}"
Jul 29 02:35:00.768609 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.768592    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 02:35:00.771523 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.771500    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 02:35:00.771612 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.771549    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 02:35:00.771654 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.771627    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:00.772212 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772194    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 02:35:00.772212 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772215    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 02:35:00.772357 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772194    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 02:35:00.772406 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772355    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 02:35:00.772406 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772367    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 02:35:00.772516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772408    2560 factory.go:55] Registering systemd factory
Jul 29 02:35:00.772516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.772424    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 29 02:35:00.774025 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774009    2560 factory.go:153] Registering CRI-O factory
Jul 29 02:35:00.774025 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774034    2560 factory.go:223] Registration of the crio container factory successfully
Jul 29 02:35:00.774181 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774108    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 02:35:00.774181 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.774093    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 02:35:00.774181 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774146    2560 factory.go:103] Registering Raw factory
Jul 29 02:35:00.774181 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.774147    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 02:35:00.774181 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774158    2560 manager.go:1196] Started watching for new ooms in manager
Jul 29 02:35:00.774628 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.774608    2560 manager.go:349] Starting recovery of all containers
Jul 29 02:35:00.780762 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.780724    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4zt7"
Jul 29 02:35:00.785525 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.785436    2560 manager.go:354] Recovery completed
Jul 29 02:35:00.787618 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.787592    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4zt7"
Jul 29 02:35:00.792338 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.792318    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.794359 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794347    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.794473 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794375    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.794473 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794385    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.795005 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794965    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 02:35:00.795005 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794982    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 02:35:00.795005 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.794993    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.795153 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.795039    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 02:35:00.795686 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.795670    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.795743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.795693    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.795743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.795703    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.796895 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.796878    2560 policy_none.go:49] "None policy: Start"
Jul 29 02:35:00.796994 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.796915    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 02:35:00.796994 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.796955    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 02:35:00.798049 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.798033    2560 policy_none.go:47] "Start"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.833347    2560 manager.go:337] "Starting Device Plugin manager"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.833566    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.833580    2560 server.go:87] "Starting device plugin registration server"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.833845    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.833860    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.834009    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.834164    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.834171    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.834675    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 02:35:00.840743 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.834717    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:00.869673 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.869613    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 02:35:00.871102 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.871071    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 02:35:00.871220 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.871114    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 02:35:00.871220 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.871140    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 02:35:00.871220 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.871187    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 02:35:00.873232 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.873205    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:00.934962 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.934858    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.935929 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.935891    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.936061 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.935947    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.936061 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.935962    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.936061 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.935992    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-22.ec2.internal"
Jul 29 02:35:00.947644 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.947614    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-22.ec2.internal"
Jul 29 02:35:00.947644 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.947647    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-22.ec2.internal\": node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:00.972350 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.972311    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"]
Jul 29 02:35:00.972521 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.972392    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.973394 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.973378    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.973485 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.973415    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.973485 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.973430    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.974937 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.974922    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.975022 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.974984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:00.975022 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975011    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.975680 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975661    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.975766 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975692    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.975766 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975667    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.975766 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975707    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.975766 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975719    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.975766 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.975732    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.977010 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.976996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:00.977087 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.977022    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:00.978987 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.978969    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:00.979087 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.979001    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:00.979087 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:00.979011    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:00.983859 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:00.983841    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:01.007792 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.007766    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-22.ec2.internal\" not found" node="ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.012205 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.012185    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-22.ec2.internal\" not found" node="ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.084651 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.084611    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:01.172999 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.172967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.173120 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.173003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.173120 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.173021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e7892a7e323d603c3a013f4adfb322-config\") pod \"kube-apiserver-proxy-ip-10-0-133-22.ec2.internal\" (UID: \"a5e7892a7e323d603c3a013f4adfb322\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.185100 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.185039    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:01.273692 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.273836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.273836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e7892a7e323d603c3a013f4adfb322-config\") pod \"kube-apiserver-proxy-ip-10-0-133-22.ec2.internal\" (UID: \"a5e7892a7e323d603c3a013f4adfb322\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.273836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e7892a7e323d603c3a013f4adfb322-config\") pod \"kube-apiserver-proxy-ip-10-0-133-22.ec2.internal\" (UID: \"a5e7892a7e323d603c3a013f4adfb322\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.273836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.273836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.273780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fdfe18d5c23abb419e354358837502d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal\" (UID: \"7fdfe18d5c23abb419e354358837502d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.285822 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.285788    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:01.310999 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.310971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.317207 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:01.317181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:01.386321 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:01.386275    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.017209 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.017115    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.117698 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.117654    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.218203 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.218156    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.234332 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.234305    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 02:35:03.234478 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.234461    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 02:35:03.318648 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.318557    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.323742 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.323709    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 02:30:02 +0000 UTC" deadline="2028-04-10 12:40:19.237958876 +0000 UTC"
Jul 29 02:35:03.323742 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.323742    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14914h5m15.914219571s"
Jul 29 02:35:03.419285 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.419232    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.519497 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:03.519461    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-22.ec2.internal\" not found"
Jul 29 02:35:03.519697 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.519682    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:03.596274 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.596196    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:03.602479 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.602455    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:03.614387 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.614364    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 02:35:03.616203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.616184    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal"
Jul 29 02:35:03.624449 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.624424    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 02:35:03.688867 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:03.688841    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:04.153832 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.153799    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:04.170598 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.170561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e7892a7e323d603c3a013f4adfb322.slice/crio-a25f48433f55ea2875d2e5bef7f96671cb84d8400bdac2316e0668c76d74366d WatchSource:0}: Error finding container a25f48433f55ea2875d2e5bef7f96671cb84d8400bdac2316e0668c76d74366d: Status 404 returned error can't find the container with id a25f48433f55ea2875d2e5bef7f96671cb84d8400bdac2316e0668c76d74366d
Jul 29 02:35:04.174873 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.174854    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:35:04.272222 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.272194    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdfe18d5c23abb419e354358837502d.slice/crio-2558925cebb2fcbb38bf2476aa83f557d2cb89ee7a4ae67f849f2ac205eefeae WatchSource:0}: Error finding container 2558925cebb2fcbb38bf2476aa83f557d2cb89ee7a4ae67f849f2ac205eefeae: Status 404 returned error can't find the container with id 2558925cebb2fcbb38bf2476aa83f557d2cb89ee7a4ae67f849f2ac205eefeae
Jul 29 02:35:04.277707 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.277678    2560 apiserver.go:52] "Watching apiserver"
Jul 29 02:35:04.285809 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.285777    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 02:35:04.286139 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.286115    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-5gp4b","openshift-ovn-kubernetes/ovnkube-node-v97ng","kube-system/konnectivity-agent-qn7xt","kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5mjf2","openshift-dns/node-resolver-hq6x5","openshift-image-registry/node-ca-hrkjw","openshift-multus/network-metrics-daemon-29x8f","kube-system/global-pull-secret-syncer-mb46c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal","openshift-multus/multus-additional-cni-plugins-2wcgm","openshift-multus/multus-t55n8","openshift-network-diagnostics/network-check-target-46kkw"]
Jul 29 02:35:04.288310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.288279    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.289727 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.289705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.290993 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.290963    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.291109 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.291081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 02:35:04.291172 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.291105    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.291172 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.291110    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c5v7l\""
Jul 29 02:35:04.291370 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.291335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.292343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.292205    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.292343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.292226    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 02:35:04.292343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.292291    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 02:35:04.292343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.292317    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hnpvg\""
Jul 29 02:35:04.292535 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.292496    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.293040 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.293020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:04.293155 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.293105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:04.293688 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.293660    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 02:35:04.293785 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.293688    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nqz7j\""
Jul 29 02:35:04.293845 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.293822    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 02:35:04.294743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.294722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.296319 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.296304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.297401 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.297370    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.297401 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.297370    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.297550 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.297391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qs6dx\""
Jul 29 02:35:04.297999 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.297986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.298084 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.298064    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:04.298386 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.298372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.298711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.298688    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.298838 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.298725    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68mbk\""
Jul 29 02:35:04.299869 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.299851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.301846 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.301830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.302495 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.302481    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.302607 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.302594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 02:35:04.302797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.302783    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.302873 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.302798    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 02:35:04.302873 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.302814    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dl8lt\""
Jul 29 02:35:04.303929 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.303913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.304347 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cc2vv\""
Jul 29 02:35:04.304451 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304414    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 02:35:04.304451 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 02:35:04.304554 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304478    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.304608 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 02:35:04.304608 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304567    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 02:35:04.305963 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.304993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.306881 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.306398    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:04.306881 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.306534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nkh8j\""
Jul 29 02:35:04.306881 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.306631    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:04.306881 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.306646    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 02:35:04.307462 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.307441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.307568 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.307531    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:04.309197 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.309176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.311240 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-kubernetes\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-systemd-units\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.311343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-multus-certs\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.311343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-etc-kubernetes\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.311343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-k8s-cni-cncf-io\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-netns\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-modprobe-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-sys\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-lib-modules\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-var-lib-kubelet\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-systemd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-etc-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311603    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggbls\""
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568ec0b7-52b8-4637-a978-43e5b7270486-iptables-alerter-script\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-dbus\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311669    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysconfig\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.311743 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-host\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-config\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5091c187-14d2-4ebb-b931-49cb63365f28-tmp-dir\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-env-overrides\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n5r6\" (UniqueName: \"kubernetes.io/projected/7e1160ae-3919-49ec-934f-3b403ac83eaf-kube-api-access-5n5r6\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-multus\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-kubelet\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5091c187-14d2-4ebb-b931-49cb63365f28-hosts-file\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-tmp\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-netns\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-node-log\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhcr\" (UniqueName: \"kubernetes.io/projected/5091c187-14d2-4ebb-b931-49cb63365f28-kube-api-access-lzhcr\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.311993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-ovn\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gtgp\" (UniqueName: \"kubernetes.io/projected/0af59ed3-6368-455c-80b9-dd575ece5a18-kube-api-access-9gtgp\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-system-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312164 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpkp\" (UniqueName: \"kubernetes.io/projected/568ec0b7-52b8-4637-a978-43e5b7270486-kube-api-access-scpkp\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-sys-fs\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cnibin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-daemon-config\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdv4p\" (UniqueName: \"kubernetes.io/projected/5f39cb20-4dbb-49f1-a882-7706c7db1259-kube-api-access-tdv4p\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-hostroot\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cni-binary-copy\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-os-release\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-socket-dir-parent\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e74d80-83b7-4d24-80fa-68a248ee9dd9-agent-certs\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-kubelet\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568ec0b7-52b8-4637-a978-43e5b7270486-host-slash\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f39cb20-4dbb-49f1-a882-7706c7db1259-serviceca\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-systemd\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-run\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.312714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-slash\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-var-lib-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-netd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-socket-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-registration-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-device-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f39cb20-4dbb-49f1-a882-7706c7db1259-host\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-conf\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.312985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-tuned\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-log-socket\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-bin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzs5\" (UniqueName: \"kubernetes.io/projected/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-kube-api-access-7mzs5\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-kubelet-config\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovn-node-metrics-cert\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-script-lib\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-conf-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e74d80-83b7-4d24-80fa-68a248ee9dd9-konnectivity-ca\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4j9\" (UniqueName: \"kubernetes.io/projected/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-kube-api-access-xb4j9\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.313753 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.313320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-bin\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.314519 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.314503    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 02:35:04.336950 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.336930    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vjxv"
Jul 29 02:35:04.348848 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.348810    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vjxv"
Jul 29 02:35:04.404166 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.404140    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 02:35:04.405868 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.405826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal" event={"ID":"7fdfe18d5c23abb419e354358837502d","Type":"ContainerStarted","Data":"2558925cebb2fcbb38bf2476aa83f557d2cb89ee7a4ae67f849f2ac205eefeae"}
Jul 29 02:35:04.406760 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.406740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal" event={"ID":"a5e7892a7e323d603c3a013f4adfb322","Type":"ContainerStarted","Data":"a25f48433f55ea2875d2e5bef7f96671cb84d8400bdac2316e0668c76d74366d"}
Jul 29 02:35:04.413594 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-var-lib-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.413687 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-netd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.413687 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cnibin\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.413687 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpvqj\" (UniqueName: \"kubernetes.io/projected/fceadac6-9c8c-422e-990b-3af17d36c589-kube-api-access-xpvqj\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-netd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-var-lib-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-socket-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-registration-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-device-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f39cb20-4dbb-49f1-a882-7706c7db1259-host\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-conf\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.413817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-tuned\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-log-socket\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f39cb20-4dbb-49f1-a882-7706c7db1259-host\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-registration-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-bin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-log-socket\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzs5\" (UniqueName: \"kubernetes.io/projected/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-kube-api-access-7mzs5\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-bin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-conf\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-kubelet-config\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-device-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-socket-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.413991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-kubelet-config\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovn-node-metrics-cert\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.414221 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-script-lib\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-conf-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-conf-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414162    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e74d80-83b7-4d24-80fa-68a248ee9dd9-konnectivity-ca\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4j9\" (UniqueName: \"kubernetes.io/projected/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-kube-api-access-xb4j9\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-bin\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-kubernetes\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-systemd-units\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415064 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-multus-certs\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-etc-kubernetes\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-k8s-cni-cncf-io\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-netns\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.414972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-kubernetes\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-cni-bin\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-modprobe-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-etc-kubernetes\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-sys\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-systemd-units\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-lib-modules\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-var-lib-kubelet\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-multus-certs\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-systemd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-etc-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568ec0b7-52b8-4637-a978-43e5b7270486-iptables-alerter-script\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-modprobe-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.415853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-netns\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-os-release\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-run-k8s-cni-cncf-io\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-var-lib-kubelet\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e74d80-83b7-4d24-80fa-68a248ee9dd9-konnectivity-ca\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-etc-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-dbus\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-script-lib\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bebd31d-8134-4583-8ad5-97814390926a-dbus\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415337    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-lib-modules\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-systemd\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysconfig\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-host\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.415398    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-sys\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-config\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5091c187-14d2-4ebb-b931-49cb63365f28-tmp-dir\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.416693 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysconfig\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.415496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:04.915475478 +0000 UTC m=+2.950192177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-host\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-env-overrides\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5r6\" (UniqueName: \"kubernetes.io/projected/7e1160ae-3919-49ec-934f-3b403ac83eaf-kube-api-access-5n5r6\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-multus\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-kubelet\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5091c187-14d2-4ebb-b931-49cb63365f28-hosts-file\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-tmp\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-netns\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-node-log\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5091c187-14d2-4ebb-b931-49cb63365f28-tmp-dir\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568ec0b7-52b8-4637-a978-43e5b7270486-iptables-alerter-script\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bngl\" (UniqueName: \"kubernetes.io/projected/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-kube-api-access-4bngl\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhcr\" (UniqueName: \"kubernetes.io/projected/5091c187-14d2-4ebb-b931-49cb63365f28-kube-api-access-lzhcr\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.417457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-ovn\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5091c187-14d2-4ebb-b931-49cb63365f28-hosts-file\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gtgp\" (UniqueName: \"kubernetes.io/projected/0af59ed3-6368-455c-80b9-dd575ece5a18-kube-api-access-9gtgp\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-system-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-cni-multus\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scpkp\" (UniqueName: \"kubernetes.io/projected/568ec0b7-52b8-4637-a978-43e5b7270486-kube-api-access-scpkp\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovnkube-config\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e1160ae-3919-49ec-934f-3b403ac83eaf-env-overrides\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-sys-fs\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cnibin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-daemon-config\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-node-log\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdv4p\" (UniqueName: \"kubernetes.io/projected/5f39cb20-4dbb-49f1-a882-7706c7db1259-kube-api-access-tdv4p\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-system-cni-dir\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-run-netns\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-hostroot\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-ovn\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cni-binary-copy\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-system-cni-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-run-openvswitch\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-os-release\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-socket-dir-parent\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-os-release\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-hostroot\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e74d80-83b7-4d24-80fa-68a248ee9dd9-agent-certs\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0af59ed3-6368-455c-80b9-dd575ece5a18-sys-fs\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cnibin\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-kubelet\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-socket-dir-parent\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.415953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-host-var-lib-kubelet\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-kubelet\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.416434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568ec0b7-52b8-4637-a978-43e5b7270486-host-slash\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.417671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-multus-daemon-config\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.418986 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.417962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f39cb20-4dbb-49f1-a882-7706c7db1259-serviceca\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-tuned\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-systemd\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-run\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568ec0b7-52b8-4637-a978-43e5b7270486-host-slash\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e1160ae-3919-49ec-934f-3b403ac83eaf-ovn-node-metrics-cert\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-tmp\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-run\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-systemd\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-etc-sysctl-d\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-slash\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e1160ae-3919-49ec-934f-3b403ac83eaf-host-slash\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f39cb20-4dbb-49f1-a882-7706c7db1259-serviceca\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.418988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e74d80-83b7-4d24-80fa-68a248ee9dd9-agent-certs\") pod \"konnectivity-agent-qn7xt\" (UID: \"76e74d80-83b7-4d24-80fa-68a248ee9dd9\") " pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.419747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.419180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-cni-binary-copy\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.421962 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.421943    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:04.422088 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.421970    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:04.422088 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.421981    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:04.422088 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.422037    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:04.922023284 +0000 UTC m=+2.956739963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:04.422402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.422106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4j9\" (UniqueName: \"kubernetes.io/projected/32e67405-6cb3-4c5d-b9c9-a79d5a6e3754-kube-api-access-xb4j9\") pod \"tuned-5mjf2\" (UID: \"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754\") " pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.422402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.422288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzs5\" (UniqueName: \"kubernetes.io/projected/17fca31d-0d72-4dd2-8c5b-55a817ecaa14-kube-api-access-7mzs5\") pod \"multus-t55n8\" (UID: \"17fca31d-0d72-4dd2-8c5b-55a817ecaa14\") " pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.423838 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.423813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n5r6\" (UniqueName: \"kubernetes.io/projected/7e1160ae-3919-49ec-934f-3b403ac83eaf-kube-api-access-5n5r6\") pod \"ovnkube-node-v97ng\" (UID: \"7e1160ae-3919-49ec-934f-3b403ac83eaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.424361 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.424341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdv4p\" (UniqueName: \"kubernetes.io/projected/5f39cb20-4dbb-49f1-a882-7706c7db1259-kube-api-access-tdv4p\") pod \"node-ca-hrkjw\" (UID: \"5f39cb20-4dbb-49f1-a882-7706c7db1259\") " pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.424459 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.424424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpkp\" (UniqueName: \"kubernetes.io/projected/568ec0b7-52b8-4637-a978-43e5b7270486-kube-api-access-scpkp\") pod \"iptables-alerter-5gp4b\" (UID: \"568ec0b7-52b8-4637-a978-43e5b7270486\") " pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.424758 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.424742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gtgp\" (UniqueName: \"kubernetes.io/projected/0af59ed3-6368-455c-80b9-dd575ece5a18-kube-api-access-9gtgp\") pod \"aws-ebs-csi-driver-node-rvzbh\" (UID: \"0af59ed3-6368-455c-80b9-dd575ece5a18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.424831 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.424815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhcr\" (UniqueName: \"kubernetes.io/projected/5091c187-14d2-4ebb-b931-49cb63365f28-kube-api-access-lzhcr\") pod \"node-resolver-hq6x5\" (UID: \"5091c187-14d2-4ebb-b931-49cb63365f28\") " pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.519321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.519321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-system-cni-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cnibin\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvqj\" (UniqueName: \"kubernetes.io/projected/fceadac6-9c8c-422e-990b-3af17d36c589-kube-api-access-xpvqj\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.519452    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-system-cni-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cnibin\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.519508    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:05.019494682 +0000 UTC m=+3.054211353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:04.519575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-os-release\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520021 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520021 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520021 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bngl\" (UniqueName: \"kubernetes.io/projected/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-kube-api-access-4bngl\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520021 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.519666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-os-release\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520209 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.520116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520209 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.520142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520328 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.520271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.520328 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.520309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.528079 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.528051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bngl\" (UniqueName: \"kubernetes.io/projected/63dd1e50-95f4-4e85-87e8-6ea09cea9d35-kube-api-access-4bngl\") pod \"multus-additional-cni-plugins-2wcgm\" (UID: \"63dd1e50-95f4-4e85-87e8-6ea09cea9d35\") " pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.528194 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.528104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvqj\" (UniqueName: \"kubernetes.io/projected/fceadac6-9c8c-422e-990b-3af17d36c589-kube-api-access-xpvqj\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:04.598220 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.598125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh"
Jul 29 02:35:04.604328 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.604303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t55n8"
Jul 29 02:35:04.608201 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.608173    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af59ed3_6368_455c_80b9_dd575ece5a18.slice/crio-a5c1b02305e42772f5eb7f70eee5e00433a9ce93f498977bc0e1db0fbb2abe3f WatchSource:0}: Error finding container a5c1b02305e42772f5eb7f70eee5e00433a9ce93f498977bc0e1db0fbb2abe3f: Status 404 returned error can't find the container with id a5c1b02305e42772f5eb7f70eee5e00433a9ce93f498977bc0e1db0fbb2abe3f
Jul 29 02:35:04.612424 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.612405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:04.612985 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.612952    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fca31d_0d72_4dd2_8c5b_55a817ecaa14.slice/crio-6035f1e311d75d3a477a0c61c0800e223662148cc73ffd0ac478ffad7177ef2b WatchSource:0}: Error finding container 6035f1e311d75d3a477a0c61c0800e223662148cc73ffd0ac478ffad7177ef2b: Status 404 returned error can't find the container with id 6035f1e311d75d3a477a0c61c0800e223662148cc73ffd0ac478ffad7177ef2b
Jul 29 02:35:04.618698 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.618672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gp4b"
Jul 29 02:35:04.622149 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.622126    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e74d80_83b7_4d24_80fa_68a248ee9dd9.slice/crio-2a30ce36879197c16f18f35ca41ca75ee17da6faeafdf8776ea1c2a2d17791dc WatchSource:0}: Error finding container 2a30ce36879197c16f18f35ca41ca75ee17da6faeafdf8776ea1c2a2d17791dc: Status 404 returned error can't find the container with id 2a30ce36879197c16f18f35ca41ca75ee17da6faeafdf8776ea1c2a2d17791dc
Jul 29 02:35:04.623102 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.623088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5mjf2"
Jul 29 02:35:04.627487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.627467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hq6x5"
Jul 29 02:35:04.627609 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.627585    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568ec0b7_52b8_4637_a978_43e5b7270486.slice/crio-8dba02e05d5aec402ceef3a77bcc6b5fd50116fb7bc359c3586d4102ae2bece0 WatchSource:0}: Error finding container 8dba02e05d5aec402ceef3a77bcc6b5fd50116fb7bc359c3586d4102ae2bece0: Status 404 returned error can't find the container with id 8dba02e05d5aec402ceef3a77bcc6b5fd50116fb7bc359c3586d4102ae2bece0
Jul 29 02:35:04.634005 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.633980    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrkjw"
Jul 29 02:35:04.634643 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.634621    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e67405_6cb3_4c5d_b9c9_a79d5a6e3754.slice/crio-113142b93a64c06dc619446397a7e0414cc1ad546ab943e1597d65ca4af123f5 WatchSource:0}: Error finding container 113142b93a64c06dc619446397a7e0414cc1ad546ab943e1597d65ca4af123f5: Status 404 returned error can't find the container with id 113142b93a64c06dc619446397a7e0414cc1ad546ab943e1597d65ca4af123f5
Jul 29 02:35:04.637853 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.637824    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5091c187_14d2_4ebb_b931_49cb63365f28.slice/crio-fe0474b97d469586aee4b88fea2ea48f9b923e9ed5c59db7594acee85844149c WatchSource:0}: Error finding container fe0474b97d469586aee4b88fea2ea48f9b923e9ed5c59db7594acee85844149c: Status 404 returned error can't find the container with id fe0474b97d469586aee4b88fea2ea48f9b923e9ed5c59db7594acee85844149c
Jul 29 02:35:04.639200 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.639111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:04.642672 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.642654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2wcgm"
Jul 29 02:35:04.643717 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.643691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f39cb20_4dbb_49f1_a882_7706c7db1259.slice/crio-fec9745c5fe3815583bc5409a3518979397e804c32621be153df1c3ef357ac3b WatchSource:0}: Error finding container fec9745c5fe3815583bc5409a3518979397e804c32621be153df1c3ef357ac3b: Status 404 returned error can't find the container with id fec9745c5fe3815583bc5409a3518979397e804c32621be153df1c3ef357ac3b
Jul 29 02:35:04.649411 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.649387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1160ae_3919_49ec_934f_3b403ac83eaf.slice/crio-1a634ade418c5acb959a4fc1101c08d7f2991cfda742fc48b533169c4aa1745e WatchSource:0}: Error finding container 1a634ade418c5acb959a4fc1101c08d7f2991cfda742fc48b533169c4aa1745e: Status 404 returned error can't find the container with id 1a634ade418c5acb959a4fc1101c08d7f2991cfda742fc48b533169c4aa1745e
Jul 29 02:35:04.651941 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:04.651834    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63dd1e50_95f4_4e85_87e8_6ea09cea9d35.slice/crio-e2328d396eeca392f05aadeaddedf607939a684b8e03d7eb7b0152fdd8389c99 WatchSource:0}: Error finding container e2328d396eeca392f05aadeaddedf607939a684b8e03d7eb7b0152fdd8389c99: Status 404 returned error can't find the container with id e2328d396eeca392f05aadeaddedf607939a684b8e03d7eb7b0152fdd8389c99
Jul 29 02:35:04.921680 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:04.921582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:04.921855 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.921739    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:04.921855 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:04.921812    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:05.921792328 +0000 UTC m=+3.956509000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:05.022698 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.022656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:05.022879 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.022759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:05.022879 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022860    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:05.022879 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022867    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:05.023098 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022892    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:05.023098 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022906    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:05.023098 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022923    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:06.022906554 +0000 UTC m=+4.057623222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:05.023098 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.022960    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:06.022943598 +0000 UTC m=+4.057660269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:05.352493 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.352397    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 02:30:04 +0000 UTC" deadline="2028-02-10 06:00:01.379938217 +0000 UTC"
Jul 29 02:35:05.352493 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.352434    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13467h24m56.027508753s"
Jul 29 02:35:05.402587 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.402101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:05.402587 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.402260    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:05.413653 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.413611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t55n8" event={"ID":"17fca31d-0d72-4dd2-8c5b-55a817ecaa14","Type":"ContainerStarted","Data":"6035f1e311d75d3a477a0c61c0800e223662148cc73ffd0ac478ffad7177ef2b"}
Jul 29 02:35:05.416761 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.416716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh" event={"ID":"0af59ed3-6368-455c-80b9-dd575ece5a18","Type":"ContainerStarted","Data":"a5c1b02305e42772f5eb7f70eee5e00433a9ce93f498977bc0e1db0fbb2abe3f"}
Jul 29 02:35:05.420068 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.420020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"1a634ade418c5acb959a4fc1101c08d7f2991cfda742fc48b533169c4aa1745e"}
Jul 29 02:35:05.421844 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.421812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5mjf2" event={"ID":"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754","Type":"ContainerStarted","Data":"113142b93a64c06dc619446397a7e0414cc1ad546ab943e1597d65ca4af123f5"}
Jul 29 02:35:05.429174 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.429138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qn7xt" event={"ID":"76e74d80-83b7-4d24-80fa-68a248ee9dd9","Type":"ContainerStarted","Data":"2a30ce36879197c16f18f35ca41ca75ee17da6faeafdf8776ea1c2a2d17791dc"}
Jul 29 02:35:05.433513 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.433458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerStarted","Data":"e2328d396eeca392f05aadeaddedf607939a684b8e03d7eb7b0152fdd8389c99"}
Jul 29 02:35:05.435681 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.435641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrkjw" event={"ID":"5f39cb20-4dbb-49f1-a882-7706c7db1259","Type":"ContainerStarted","Data":"fec9745c5fe3815583bc5409a3518979397e804c32621be153df1c3ef357ac3b"}
Jul 29 02:35:05.438705 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.438639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hq6x5" event={"ID":"5091c187-14d2-4ebb-b931-49cb63365f28","Type":"ContainerStarted","Data":"fe0474b97d469586aee4b88fea2ea48f9b923e9ed5c59db7594acee85844149c"}
Jul 29 02:35:05.441848 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.441807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gp4b" event={"ID":"568ec0b7-52b8-4637-a978-43e5b7270486","Type":"ContainerStarted","Data":"8dba02e05d5aec402ceef3a77bcc6b5fd50116fb7bc359c3586d4102ae2bece0"}
Jul 29 02:35:05.931511 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:05.931466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:05.931708 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.931616    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:05.931708 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:05.931677    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:07.93166066 +0000 UTC m=+5.966377331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:06.032769 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.032726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:06.032980 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.032843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:06.033046 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.032990    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:06.033097 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.033061    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:08.033042014 +0000 UTC m=+6.067758682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:06.033201 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.033185    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:06.033285 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.033211    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:06.033285 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.033225    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:06.033285 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.033279    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:08.033266272 +0000 UTC m=+6.067982944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:06.352899 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.352760    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 02:30:04 +0000 UTC" deadline="2027-12-29 07:05:27.047032832 +0000 UTC"
Jul 29 02:35:06.352899 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.352828    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12436h30m20.694209672s"
Jul 29 02:35:06.403189 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.403151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:06.403372 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.403328    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:06.403683 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:06.403644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:06.403967 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:06.403936    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:07.402149 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:07.402054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:07.402864 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:07.402194    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:07.950981 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:07.950937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:07.951195 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:07.951154    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:07.951286 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:07.951221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:11.951201955 +0000 UTC m=+9.985918624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:08.051429 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:08.051387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:08.051606 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:08.051447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:08.051663 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.051613    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:08.051663 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.051632    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:08.051663 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.051644    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:08.051833 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.051720    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:12.051700681 +0000 UTC m=+10.086417371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:08.052266 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.052222    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:08.052394 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.052301    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:12.052285174 +0000 UTC m=+10.087001848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:08.405541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:08.405408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:08.405541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:08.405506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:08.406042 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.405608    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:08.406042 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:08.405701    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:09.402541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:09.402507    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:09.402718 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:09.402650    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:10.402456 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:10.402421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:10.402914 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:10.402568    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:10.402914 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:10.402421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:10.402914 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:10.402790    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:11.402187 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:11.402152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:11.402401 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:11.402303    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:11.988425 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:11.988343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:11.988864 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:11.988492    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:11.988864 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:11.988559    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:19.988538945 +0000 UTC m=+18.023255612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:12.089826 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:12.089727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:12.089826 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:12.089787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:12.090041 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.089965    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:12.090041 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.090034    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:12.090200 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.090050    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:20.090026322 +0000 UTC m=+18.124743006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:12.090200 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.090055    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:12.090200 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.090085    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:12.090200 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.090124    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:20.090113283 +0000 UTC m=+18.124829966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:12.404053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:12.403539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:12.404053 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.403657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:12.404053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:12.403713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:12.404053 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:12.403846    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:13.401876 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:13.401843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:13.402376 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:13.401970    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:14.405640 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:14.405397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:14.406089 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:14.405444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:14.406089 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:14.405744    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:14.406089 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:14.405875    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:15.402613 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:15.402573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:15.402788 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:15.402718    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:16.401829 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:16.401795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:16.402344 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:16.401795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:16.402344 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:16.401914    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:16.402344 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:16.402010    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:17.402386 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:17.402341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:17.402857 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:17.402490    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:18.402513 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:18.402474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:18.402970 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:18.402474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:18.402970 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:18.402616    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:18.402970 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:18.402695    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:19.401993 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:19.401957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:19.402279 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:19.402105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:20.048894 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:20.048850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:20.049375 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.048990    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:20.049375 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.049074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:36.049059349 +0000 UTC m=+34.083776020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:20.149841 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:20.149803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:20.149841 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:20.149848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.149981    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.150006    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.150026    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.150037    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.150053    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:36.150038206 +0000 UTC m=+34.184754873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:20.150085 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.150076    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:36.150063206 +0000 UTC m=+34.184779876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:20.402658 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:20.402575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:20.402814 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.402719    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:20.402814 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:20.402788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:20.402949 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:20.402917    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:21.401701 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:21.401669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:21.402096 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:21.401793    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:22.403236 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:22.403198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:22.403720 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:22.403337    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:22.403720 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:22.403401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:22.403720 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:22.403521    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:23.402536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:23.402502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:23.402694 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:23.402601    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:24.402575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.402367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:24.403371 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:24.402731    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:24.403371 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.402833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:24.403371 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:24.402909    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:24.485611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.485575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t55n8" event={"ID":"17fca31d-0d72-4dd2-8c5b-55a817ecaa14","Type":"ContainerStarted","Data":"d01353722291c8e6393ee5230198781a4384021d5c9889a5522c066f5768b314"}
Jul 29 02:35:24.487294 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.487239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh" event={"ID":"0af59ed3-6368-455c-80b9-dd575ece5a18","Type":"ContainerStarted","Data":"83f52cb1fed7dd7e3ffdb74470057ca4083cb39d38e7f83f563902b59b6628ad"}
Jul 29 02:35:24.489193 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.489163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"162dcf904ad6081f980f48b4c14425aaed8606cb53c9ad3b02314007e36f719b"}
Jul 29 02:35:24.489322 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.489239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"79abf63d0aeb1fce35a8708da56dc3842a108a689914ebfb838f5b2e42c2b570"}
Jul 29 02:35:24.490556 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.490531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5mjf2" event={"ID":"32e67405-6cb3-4c5d-b9c9-a79d5a6e3754","Type":"ContainerStarted","Data":"1681482390e59f160b6c24b57db9c8189e22bb279197dd382f2b06173ac41946"}
Jul 29 02:35:24.492158 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.492128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qn7xt" event={"ID":"76e74d80-83b7-4d24-80fa-68a248ee9dd9","Type":"ContainerStarted","Data":"b62016b78d18bbd5f7b389cff69c3c8f13767bb160585a0d8c661221690ff68b"}
Jul 29 02:35:24.493498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.493476    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fdfe18d5c23abb419e354358837502d" containerID="d1fe28c7f8f23ba7b6ca0613801cc22348810d8ca34bb62e3890bb4ec1663c12" exitCode=0
Jul 29 02:35:24.493559 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.493542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal" event={"ID":"7fdfe18d5c23abb419e354358837502d","Type":"ContainerDied","Data":"d1fe28c7f8f23ba7b6ca0613801cc22348810d8ca34bb62e3890bb4ec1663c12"}
Jul 29 02:35:24.494655 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.494633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal" event={"ID":"a5e7892a7e323d603c3a013f4adfb322","Type":"ContainerStarted","Data":"a6e8afe38acf9c42a359f1694019218fcddeec092d4997b0b125219a1ccf8158"}
Jul 29 02:35:24.495904 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.495883    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="15b303144474ea3a70bf72d30666898929f68bdf93428e7f8a1b6bc7c35e5d16" exitCode=0
Jul 29 02:35:24.495962 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.495946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"15b303144474ea3a70bf72d30666898929f68bdf93428e7f8a1b6bc7c35e5d16"}
Jul 29 02:35:24.497261 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.497214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrkjw" event={"ID":"5f39cb20-4dbb-49f1-a882-7706c7db1259","Type":"ContainerStarted","Data":"decc2f637d1548080b894df5d228649556e631ed6c8f078349c766a7e2368bc4"}
Jul 29 02:35:24.498407 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.498375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hq6x5" event={"ID":"5091c187-14d2-4ebb-b931-49cb63365f28","Type":"ContainerStarted","Data":"7dfbb71a5f631fadb33f98d7b188d3ac8be159959a5a2a97c509a5e5d8df4f8d"}
Jul 29 02:35:24.503199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.503161    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t55n8" podStartSLOduration=3.454721159 podStartE2EDuration="22.50314876s" totalImagesPullingTime="19.048427601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.502727092 +0000 UTC m=+22.537443782" watchObservedRunningTime="2026-07-29 02:35:24.50314876 +0000 UTC m=+22.537865449"
Jul 29 02:35:24.515222 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.515173    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-22.ec2.internal" podStartSLOduration=21.515153566 podStartE2EDuration="21.515153566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.514804927 +0000 UTC m=+22.549521616" watchObservedRunningTime="2026-07-29 02:35:24.515153566 +0000 UTC m=+22.549870254"
Jul 29 02:35:24.529870 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.529818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5mjf2" podStartSLOduration=3.522476744 podStartE2EDuration="22.529794666s" totalImagesPullingTime="19.007317922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.529603334 +0000 UTC m=+22.564320023" watchObservedRunningTime="2026-07-29 02:35:24.529794666 +0000 UTC m=+22.564511355"
Jul 29 02:35:24.543072 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.543021    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hrkjw" podStartSLOduration=7.796951033 podStartE2EDuration="22.543005726s" totalImagesPullingTime="14.746054693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.542851893 +0000 UTC m=+22.577568583" watchObservedRunningTime="2026-07-29 02:35:24.543005726 +0000 UTC m=+22.577722415"
Jul 29 02:35:24.561797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.561747    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qn7xt" podStartSLOduration=3.543485973 podStartE2EDuration="22.561730822s" totalImagesPullingTime="19.018244849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.561464458 +0000 UTC m=+22.596181165" watchObservedRunningTime="2026-07-29 02:35:24.561730822 +0000 UTC m=+22.596447510"
Jul 29 02:35:24.585628 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:24.585369    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hq6x5" podStartSLOduration=7.832938886 podStartE2EDuration="22.585351215s" totalImagesPullingTime="14.752412329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:24.584978098 +0000 UTC m=+22.619694788" watchObservedRunningTime="2026-07-29 02:35:24.585351215 +0000 UTC m=+22.620067904"
Jul 29 02:35:25.402761 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.402680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:25.403131 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:25.402808    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:25.504633 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.504586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"95d47b93139cda6dab7798a020fe40e5281cd9f6433f25dbc0889c45fa9c453c"}
Jul 29 02:35:25.504832 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.504690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"db6d4789fa99e7e63d0c50f71d896eb5b3af0ffe5dc787bec6b393284906078b"}
Jul 29 02:35:25.504832 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.504735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"b2bcc854a3d556e405ad9b099a7b7610266d76ed9a570582210ce1980faaaddf"}
Jul 29 02:35:25.504832 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.504778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"d3b200e9778c987f5d90032a1dbf74612b962becbfe02521c4a7a2a066fecf75"}
Jul 29 02:35:25.506072 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.506047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gp4b" event={"ID":"568ec0b7-52b8-4637-a978-43e5b7270486","Type":"ContainerStarted","Data":"f123807e1d7d4528186f696f0cdf4fdcd6d0b2f54e2630c4992304df75953272"}
Jul 29 02:35:25.538654 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.538596    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5gp4b" podStartSLOduration=4.919138575 podStartE2EDuration="23.538578446s" totalImagesPullingTime="18.619439871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:25.538436035 +0000 UTC m=+23.573152724" watchObservedRunningTime="2026-07-29 02:35:25.538578446 +0000 UTC m=+23.573295135"
Jul 29 02:35:25.685045 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:25.685002    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 02:35:26.380204 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.380053    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T02:35:25.685021135Z","UUID":"80c850ee-f8df-4b84-9dce-3297ffde2eff","Handler":null,"Name":"","Endpoint":""}
Jul 29 02:35:26.381508 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.381490    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 02:35:26.381636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.381524    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 02:35:26.402671 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.402639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:26.402851 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.402638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:26.402851 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:26.402805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:26.403208 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:26.402902    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:26.510892 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.510856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh" event={"ID":"0af59ed3-6368-455c-80b9-dd575ece5a18","Type":"ContainerStarted","Data":"d0fc7f152fb518762cafc2d384cfd6af0d3bfeb138ab3ec79bff96715ddb4d42"}
Jul 29 02:35:26.512844 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.512811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal" event={"ID":"7fdfe18d5c23abb419e354358837502d","Type":"ContainerStarted","Data":"3fde9124b43d646aed438a286ae1dd35e2f45dd8128ff35f837883aa25abb14a"}
Jul 29 02:35:26.529024 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:26.528962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-22.ec2.internal" podStartSLOduration=23.528939738 podStartE2EDuration="23.528939738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:26.528797226 +0000 UTC m=+24.563513917" watchObservedRunningTime="2026-07-29 02:35:26.528939738 +0000 UTC m=+24.563656425"
Jul 29 02:35:27.402579 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:27.402495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:27.402757 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:27.402613    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:27.775309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:27.775268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:27.775880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:27.775859    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:28.402467 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:28.402433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:28.402635 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:28.402484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:28.402635 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:28.402580    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:28.402714 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:28.402678    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:28.517321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:28.517289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:28.517804 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:28.517774    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qn7xt"
Jul 29 02:35:29.402568 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:29.402376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:29.402987 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:29.402668    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:29.520308 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:29.520275    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="fad3c77144cf211221555408485b703098b5e8152d6c94e2fb7ef43c4f80ba36" exitCode=0
Jul 29 02:35:29.520500 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:29.520368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"fad3c77144cf211221555408485b703098b5e8152d6c94e2fb7ef43c4f80ba36"}
Jul 29 02:35:29.522662 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:29.522635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh" event={"ID":"0af59ed3-6368-455c-80b9-dd575ece5a18","Type":"ContainerStarted","Data":"fd747e1df63dc52dbfde1aa2f3e9a6f33d6f4d9c65c801378cfc0935645c302d"}
Jul 29 02:35:29.526258 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:29.526221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"84a62ab0e3bc1c842028846698cf17e1e9d34a4049382dcbcf913fb10d0443d0"}
Jul 29 02:35:30.402591 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:30.402562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:30.403077 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:30.402572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:30.403077 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:30.402691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:30.403077 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:30.402735    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:30.530533 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:30.530497    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="b655abb2e2888a9619522519a11dc2950974075a24e919bdf717c28886ca6e58" exitCode=0
Jul 29 02:35:30.530725 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:30.530585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"b655abb2e2888a9619522519a11dc2950974075a24e919bdf717c28886ca6e58"}
Jul 29 02:35:30.552225 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:30.552171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvzbh" podStartSLOduration=5.366052767 podStartE2EDuration="28.552156163s" totalImagesPullingTime="23.186103396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:29.560101359 +0000 UTC m=+27.594818072" watchObservedRunningTime="2026-07-29 02:35:30.552156163 +0000 UTC m=+28.586872929"
Jul 29 02:35:31.402471 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.402358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:31.402471 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:31.402461    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:31.534988 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.534958    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="59f6458b2e9c362bf1c3786820fd536362f4938ca400aacaf09f112fc43c4619" exitCode=0
Jul 29 02:35:31.535747 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.535035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"59f6458b2e9c362bf1c3786820fd536362f4938ca400aacaf09f112fc43c4619"}
Jul 29 02:35:31.538872 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.538846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" event={"ID":"7e1160ae-3919-49ec-934f-3b403ac83eaf","Type":"ContainerStarted","Data":"894465ee8c0bbbab3f32ddef58d11a429460a64eee65fd7455ad7b40bda2aac5"}
Jul 29 02:35:31.539099 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.539086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:31.555455 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.555427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:31.585896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:31.585840    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng" podStartSLOduration=10.064190097000001 podStartE2EDuration="29.585822803s" totalImagesPullingTime="19.521632706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:31.585428791 +0000 UTC m=+29.620145480" watchObservedRunningTime="2026-07-29 02:35:31.585822803 +0000 UTC m=+29.620539491"
Jul 29 02:35:32.402410 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:32.402376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:32.402578 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:32.402501    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:32.402578 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:32.402550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:32.402706 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:32.402657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:32.541284 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:32.541230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:32.541751 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:32.541332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:32.556844 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:32.556811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:35:33.041226 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.040545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29x8f"]
Jul 29 02:35:33.041226 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.040704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:33.041226 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:33.040828    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:33.043359 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.043191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46kkw"]
Jul 29 02:35:33.043359 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.043310    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:33.043584 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:33.043416    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:33.056119 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.056088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mb46c"]
Jul 29 02:35:33.056330 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:33.056220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:33.056397 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:33.056350    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:34.402677 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:34.402631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:34.403194 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:34.402788    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:34.403194 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:34.402865    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:34.403194 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:34.402953    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:35.402256 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:35.402223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:35.402394 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:35.402353    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46kkw" podUID="657f5ec0-07c9-423c-aae8-a2bd56b87076"
Jul 29 02:35:36.058550 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.058506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:36.058965 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.058663    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:36.058965 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.058731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret podName:5bebd31d-8134-4583-8ad5-97814390926a nodeName:}" failed. No retries permitted until 2026-07-29 02:36:08.058714288 +0000 UTC m=+66.093430960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret") pod "global-pull-secret-syncer-mb46c" (UID: "5bebd31d-8134-4583-8ad5-97814390926a") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:36.159094 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.159058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:36.159094 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.159099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:36.159302 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159212    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:36.159302 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159296    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs podName:fceadac6-9c8c-422e-990b-3af17d36c589 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:08.159281071 +0000 UTC m=+66.193997742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs") pod "network-metrics-daemon-29x8f" (UID: "fceadac6-9c8c-422e-990b-3af17d36c589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:36.159404 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159216    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:36.159404 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159319    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:36.159404 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159328    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9lrs6 for pod openshift-network-diagnostics/network-check-target-46kkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:36.159404 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.159367    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6 podName:657f5ec0-07c9-423c-aae8-a2bd56b87076 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:08.159356525 +0000 UTC m=+66.194073192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9lrs6" (UniqueName: "kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6") pod "network-check-target-46kkw" (UID: "657f5ec0-07c9-423c-aae8-a2bd56b87076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:36.402433 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.402351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:36.402433 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.402367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:36.402639 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.402481    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mb46c" podUID="5bebd31d-8134-4583-8ad5-97814390926a"
Jul 29 02:35:36.402639 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:36.402612    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29x8f" podUID="fceadac6-9c8c-422e-990b-3af17d36c589"
Jul 29 02:35:36.553086 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.552899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerStarted","Data":"2f397f53fe2b6099fe81b2310a6fb78097f88cfa49492a9ce5afcb407d0feedc"}
Jul 29 02:35:36.813347 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.813319    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-22.ec2.internal" event="NodeReady"
Jul 29 02:35:36.813517 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.813440    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 02:35:36.851304 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.851236    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:35:36.867512 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.867481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8pjnm"]
Jul 29 02:35:36.867701 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.867667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.870013 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.869988    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9hmnf\""
Jul 29 02:35:36.870334 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.870312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 02:35:36.870489 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.870316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 02:35:36.870489 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.870363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 02:35:36.880009 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.879987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:35:36.880105 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.880021    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wst4g"]
Jul 29 02:35:36.880157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.880138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:36.882567 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.882541    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 02:35:36.882719 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.882634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdc6x\""
Jul 29 02:35:36.882719 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.882704    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 02:35:36.886343 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.886315    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 02:35:36.900367 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.900338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pjnm"]
Jul 29 02:35:36.900520 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.900380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wst4g"]
Jul 29 02:35:36.900520 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.900445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:36.903056 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.903035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 02:35:36.903202 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.903149    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 02:35:36.903289 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.903233    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v2jkq\""
Jul 29 02:35:36.903289 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.903270    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 02:35:36.965826 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.965783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.965826 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.965823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.965850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zbm\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.965942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.965984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78da0e9a-4047-4386-b822-31cb5f3b709f-config-volume\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:36.966052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df498\" (UniqueName: \"kubernetes.io/projected/778c18ab-e223-42e4-aa27-eebba3ec33df-kube-api-access-df498\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da0e9a-4047-4386-b822-31cb5f3b709f-tmp-dir\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hd22\" (UniqueName: \"kubernetes.io/projected/78da0e9a-4047-4386-b822-31cb5f3b709f-kube-api-access-7hd22\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:36.966303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:36.966240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778c18ab-e223-42e4-aa27-eebba3ec33df-cert\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.000447 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.000414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:37.067638 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.067638 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.067638 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778c18ab-e223-42e4-aa27-eebba3ec33df-cert\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zbm\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.067707    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78da0e9a-4047-4386-b822-31cb5f3b709f-config-volume\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.067797    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:35:37.567775861 +0000 UTC m=+35.602492529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df498\" (UniqueName: \"kubernetes.io/projected/778c18ab-e223-42e4-aa27-eebba3ec33df-kube-api-access-df498\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da0e9a-4047-4386-b822-31cb5f3b709f-tmp-dir\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.067993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hd22\" (UniqueName: \"kubernetes.io/projected/78da0e9a-4047-4386-b822-31cb5f3b709f-kube-api-access-7hd22\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.068199 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.068210    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.068225    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.068236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.068333    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:37.568316576 +0000 UTC m=+35.603033260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.068519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da0e9a-4047-4386-b822-31cb5f3b709f-tmp-dir\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.068684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.068990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.068782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78da0e9a-4047-4386-b822-31cb5f3b709f-config-volume\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.069232 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.069153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.072528 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.072491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.072652 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.072501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.072652 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.072501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778c18ab-e223-42e4-aa27-eebba3ec33df-cert\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.079106 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.079071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hd22\" (UniqueName: \"kubernetes.io/projected/78da0e9a-4047-4386-b822-31cb5f3b709f-kube-api-access-7hd22\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.079474 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.079450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df498\" (UniqueName: \"kubernetes.io/projected/778c18ab-e223-42e4-aa27-eebba3ec33df-kube-api-access-df498\") pod \"ingress-canary-wst4g\" (UID: \"778c18ab-e223-42e4-aa27-eebba3ec33df\") " pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.079555 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.079473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.079602 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.079586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zbm\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.081514 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.081482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:37.208744 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.208707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wst4g"
Jul 29 02:35:37.382909 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.382877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wst4g"]
Jul 29 02:35:37.386467 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:37.386436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778c18ab_e223_42e4_aa27_eebba3ec33df.slice/crio-bf2406a0a2d06b2233ea0e687dfa095cbc3b8bcc4aef97572f7c3add841772c3 WatchSource:0}: Error finding container bf2406a0a2d06b2233ea0e687dfa095cbc3b8bcc4aef97572f7c3add841772c3: Status 404 returned error can't find the container with id bf2406a0a2d06b2233ea0e687dfa095cbc3b8bcc4aef97572f7c3add841772c3
Jul 29 02:35:37.402658 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.402623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:35:37.405387 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.405365    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 02:35:37.405479 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.405423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngnfs\""
Jul 29 02:35:37.405521 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.405365    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 02:35:37.558554 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.558521    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="2f397f53fe2b6099fe81b2310a6fb78097f88cfa49492a9ce5afcb407d0feedc" exitCode=0
Jul 29 02:35:37.558749 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.558600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"2f397f53fe2b6099fe81b2310a6fb78097f88cfa49492a9ce5afcb407d0feedc"}
Jul 29 02:35:37.559927 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.559842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wst4g" event={"ID":"778c18ab-e223-42e4-aa27-eebba3ec33df","Type":"ContainerStarted","Data":"bf2406a0a2d06b2233ea0e687dfa095cbc3b8bcc4aef97572f7c3add841772c3"}
Jul 29 02:35:37.572734 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.572695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:37.572925 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:37.572780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:37.572925 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.572854    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:37.572925 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.572880    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:37.572925 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.572890    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:37.572925 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.572917    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.572901359 +0000 UTC m=+36.607618026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:37.573105 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:37.572931    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.572925134 +0000 UTC m=+36.607641802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:38.209852 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.209650    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"]
Jul 29 02:35:38.232470 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.232421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-lc687"]
Jul 29 02:35:38.232651 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.232550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.235541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.235507    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nw56l\""
Jul 29 02:35:38.235715 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.235542    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.237421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.237385    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 02:35:38.237759 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.237729    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 02:35:38.238497 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.238325    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.248402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.248343    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"]
Jul 29 02:35:38.248402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.248394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"]
Jul 29 02:35:38.248599 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.248457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.251033 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.251005    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 02:35:38.251033 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.251027    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gs6jh\""
Jul 29 02:35:38.251272 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.251027    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 02:35:38.251603 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.251558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.251702 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.251656    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.256028 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.255998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 02:35:38.268525 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.268488    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-l9tw4"]
Jul 29 02:35:38.268720 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.268554    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.271611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.271123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 02:35:38.271611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.271198    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.271611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.271372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vk4lg\""
Jul 29 02:35:38.271611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.271460    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 02:35:38.271611 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.271537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.292659 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.292623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-lc687"]
Jul 29 02:35:38.292659 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.292668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-l9tw4"]
Jul 29 02:35:38.292910 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.292685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"]
Jul 29 02:35:38.292910 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.292717    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"]
Jul 29 02:35:38.292910 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.292818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.296056 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.296029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 02:35:38.296056 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.296029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.296310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.296292    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bxhtw\""
Jul 29 02:35:38.296310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.296303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 02:35:38.296428 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.296414    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.303991 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.303795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 02:35:38.312625 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.312597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"]
Jul 29 02:35:38.312803 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.312730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"
Jul 29 02:35:38.313053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.313033    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f7bcd7cf-nm5fw"]
Jul 29 02:35:38.315365 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.315337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.315365 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.315345    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.315540 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.315381    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k9rb7\""
Jul 29 02:35:38.334850 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.334806    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f7bcd7cf-nm5fw"]
Jul 29 02:35:38.335053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.334931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.337580 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 02:35:38.337732 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 02:35:38.337795 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337735    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 02:35:38.337868 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337850    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.337961 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337942    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.338011 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.337946    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lhxjz\""
Jul 29 02:35:38.338237 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.338206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 02:35:38.380321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xxr\" (UniqueName: \"kubernetes.io/projected/01daba41-2f6a-4416-a2d5-b5ecea850aa2-kube-api-access-77xxr\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f497a683-8dce-456e-9940-3a9728fb3c5b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbhv\" (UniqueName: \"kubernetes.io/projected/f497a683-8dce-456e-9940-3a9728fb3c5b-kube-api-access-xtbhv\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjmr\" (UniqueName: \"kubernetes.io/projected/7a747d4e-0878-4732-8e2a-18e8c8c955b8-kube-api-access-dxjmr\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-trusted-ca\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.380498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e904d051-def7-468b-85e5-5aa470c9c79b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-service-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a747d4e-0878-4732-8e2a-18e8c8c955b8-serving-cert\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-tmp\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-snapshots\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380711 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlz4f\" (UniqueName: \"kubernetes.io/projected/e904d051-def7-468b-85e5-5aa470c9c79b-kube-api-access-jlz4f\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.380917 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01daba41-2f6a-4416-a2d5-b5ecea850aa2-serving-cert\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.380917 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e904d051-def7-468b-85e5-5aa470c9c79b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.380917 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.380798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-config\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.401911 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.401879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:35:38.401911 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.401908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:35:38.404652 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.404629    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2t7w\""
Jul 29 02:35:38.404652 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.404645    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 02:35:38.404827 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.404638    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 02:35:38.415233 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.415204    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"]
Jul 29 02:35:38.436348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.436223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:38.438809 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.438780    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"]
Jul 29 02:35:38.438983 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.438901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.441803 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.441777    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.441939 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.441782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.441939 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.441812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 02:35:38.441939 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.441852    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t4jbd\""
Jul 29 02:35:38.454941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.454908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"]
Jul 29 02:35:38.455120 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.455031    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"]
Jul 29 02:35:38.455120 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.455051    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"]
Jul 29 02:35:38.455240 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.455190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.457637 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.457613    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 02:35:38.457942 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.457922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:38.458049 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.458009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s8psb\""
Jul 29 02:35:38.458286 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.458258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:38.458504 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.458483    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 02:35:38.472965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.472939    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"]
Jul 29 02:35:38.473162 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.473067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"
Jul 29 02:35:38.475526 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.475496    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fnj5h\""
Jul 29 02:35:38.482699 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.482527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e904d051-def7-468b-85e5-5aa470c9c79b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.482699 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.482580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.482699 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.482606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjxp\" (UniqueName: \"kubernetes.io/projected/f4304694-f029-4ca7-b683-7c37bf5b4429-kube-api-access-jbjxp\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.483000 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.482974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-config\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.483077 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xxr\" (UniqueName: \"kubernetes.io/projected/01daba41-2f6a-4416-a2d5-b5ecea850aa2-kube-api-access-77xxr\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.483141 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-stats-auth\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.483194 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f497a683-8dce-456e-9940-3a9728fb3c5b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.483348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbhv\" (UniqueName: \"kubernetes.io/projected/f497a683-8dce-456e-9940-3a9728fb3c5b-kube-api-access-xtbhv\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.483425 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjmr\" (UniqueName: \"kubernetes.io/projected/7a747d4e-0878-4732-8e2a-18e8c8c955b8-kube-api-access-dxjmr\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.483483 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.483483 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-default-certificate\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.483584 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-trusted-ca\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.483584 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.483584 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e904d051-def7-468b-85e5-5aa470c9c79b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.483732 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-service-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.483732 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a747d4e-0878-4732-8e2a-18e8c8c955b8-serving-cert\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.483826 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.483892 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-tmp\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.483945 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-snapshots\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.484000 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.483974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smq5r\" (UniqueName: \"kubernetes.io/projected/1a4686e8-c644-4409-9b9a-56d2bf89cb3a-kube-api-access-smq5r\") pod \"volume-data-source-validator-549c6d54cf-nld9d\" (UID: \"1a4686e8-c644-4409-9b9a-56d2bf89cb3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"
Jul 29 02:35:38.484052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.484007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-config\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.484052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.484037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlz4f\" (UniqueName: \"kubernetes.io/projected/e904d051-def7-468b-85e5-5aa470c9c79b-kube-api-access-jlz4f\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.484143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.484086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01daba41-2f6a-4416-a2d5-b5ecea850aa2-serving-cert\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.484405 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.484380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-service-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.484764 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.484737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f497a683-8dce-456e-9940-3a9728fb3c5b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.484980 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.484958    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:38.485360 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.485101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.985072948 +0000 UTC m=+37.019789633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:38.485941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.485582    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e904d051-def7-468b-85e5-5aa470c9c79b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.485941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.485595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a747d4e-0878-4732-8e2a-18e8c8c955b8-trusted-ca\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.485941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.485857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-tmp\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.487478 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.486852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01daba41-2f6a-4416-a2d5-b5ecea850aa2-snapshots\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.487478 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.487430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01daba41-2f6a-4416-a2d5-b5ecea850aa2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.487635 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.487506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e904d051-def7-468b-85e5-5aa470c9c79b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.487777 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.487753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01daba41-2f6a-4416-a2d5-b5ecea850aa2-serving-cert\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.488023 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.488004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a747d4e-0878-4732-8e2a-18e8c8c955b8-serving-cert\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.494772 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.494731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xxr\" (UniqueName: \"kubernetes.io/projected/01daba41-2f6a-4416-a2d5-b5ecea850aa2-kube-api-access-77xxr\") pod \"insights-operator-5885fdb759-l9tw4\" (UID: \"01daba41-2f6a-4416-a2d5-b5ecea850aa2\") " pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.495908 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.495852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjmr\" (UniqueName: \"kubernetes.io/projected/7a747d4e-0878-4732-8e2a-18e8c8c955b8-kube-api-access-dxjmr\") pod \"console-operator-584dcb6b54-lc687\" (UID: \"7a747d4e-0878-4732-8e2a-18e8c8c955b8\") " pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.496596 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.496546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlz4f\" (UniqueName: \"kubernetes.io/projected/e904d051-def7-468b-85e5-5aa470c9c79b-kube-api-access-jlz4f\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z282s\" (UID: \"e904d051-def7-468b-85e5-5aa470c9c79b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.496939 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.496890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbhv\" (UniqueName: \"kubernetes.io/projected/f497a683-8dce-456e-9940-3a9728fb3c5b-kube-api-access-xtbhv\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.498813 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.498788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:38.560592 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.560551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:38.566219 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.566179    2560 generic.go:356] "Generic (PLEG): container finished" podID="63dd1e50-95f4-4e85-87e8-6ea09cea9d35" containerID="98714e4459679997a9a6375d7392373bb04e4b0781f2ac4d91342b010e9d5d5c" exitCode=0
Jul 29 02:35:38.566398 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.566237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerDied","Data":"98714e4459679997a9a6375d7392373bb04e4b0781f2ac4d91342b010e9d5d5c"}
Jul 29 02:35:38.581729 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.581694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"
Jul 29 02:35:38.584702 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7976ea-0897-4d88-941a-1daea881c234-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.584879 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smq5r\" (UniqueName: \"kubernetes.io/projected/1a4686e8-c644-4409-9b9a-56d2bf89cb3a-kube-api-access-smq5r\") pod \"volume-data-source-validator-549c6d54cf-nld9d\" (UID: \"1a4686e8-c644-4409-9b9a-56d2bf89cb3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"
Jul 29 02:35:38.584879 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6kvb\" (UniqueName: \"kubernetes.io/projected/3c7976ea-0897-4d88-941a-1daea881c234-kube-api-access-m6kvb\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.585007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:38.585007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.585007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjxp\" (UniqueName: \"kubernetes.io/projected/f4304694-f029-4ca7-b683-7c37bf5b4429-kube-api-access-jbjxp\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.585007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.584982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c7976ea-0897-4d88-941a-1daea881c234-config\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.585220 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-stats-auth\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.585220 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcnm\" (UniqueName: \"kubernetes.io/projected/164f6f46-c328-4c86-9b9b-8c640b30743e-kube-api-access-trcnm\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.585220 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585064    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:38.585220 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585205    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585237    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:39.085213998 +0000 UTC m=+37.119930672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585302    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585314    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:35:40.585297396 +0000 UTC m=+38.620014066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.585441 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585317    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:38.585859 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585502    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:40.585489174 +0000 UTC m=+38.620205843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:38.585859 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzc4x\" (UniqueName: \"kubernetes.io/projected/5a9f93fe-59e9-4302-b9cc-7babf7039c06-kube-api-access-vzc4x\") pod \"network-check-source-7d88cb55d8-2xfbq\" (UID: \"5a9f93fe-59e9-4302-b9cc-7babf7039c06\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"
Jul 29 02:35:38.585859 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.585559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-default-certificate\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.585859 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.585794    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:39.085780964 +0000 UTC m=+37.120497650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:38.586284 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.586140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.588538 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.588509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-stats-auth\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.588667 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.588603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-default-certificate\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.594661 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.594626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjxp\" (UniqueName: \"kubernetes.io/projected/f4304694-f029-4ca7-b683-7c37bf5b4429-kube-api-access-jbjxp\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:38.594910 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.594874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smq5r\" (UniqueName: \"kubernetes.io/projected/1a4686e8-c644-4409-9b9a-56d2bf89cb3a-kube-api-access-smq5r\") pod \"volume-data-source-validator-549c6d54cf-nld9d\" (UID: \"1a4686e8-c644-4409-9b9a-56d2bf89cb3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"
Jul 29 02:35:38.606738 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.606707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-l9tw4"
Jul 29 02:35:38.622653 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.622613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"
Jul 29 02:35:38.688537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.687165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7976ea-0897-4d88-941a-1daea881c234-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.688628 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.688527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6kvb\" (UniqueName: \"kubernetes.io/projected/3c7976ea-0897-4d88-941a-1daea881c234-kube-api-access-m6kvb\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.689840 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.689814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c7976ea-0897-4d88-941a-1daea881c234-config\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.689957 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.689910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c7976ea-0897-4d88-941a-1daea881c234-config\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.690026 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.689997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcnm\" (UniqueName: \"kubernetes.io/projected/164f6f46-c328-4c86-9b9b-8c640b30743e-kube-api-access-trcnm\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.690094 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.690077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.690151 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.690108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzc4x\" (UniqueName: \"kubernetes.io/projected/5a9f93fe-59e9-4302-b9cc-7babf7039c06-kube-api-access-vzc4x\") pod \"network-check-source-7d88cb55d8-2xfbq\" (UID: \"5a9f93fe-59e9-4302-b9cc-7babf7039c06\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"
Jul 29 02:35:38.694293 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.690394    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:38.694293 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.690494    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:35:39.190470187 +0000 UTC m=+37.225186880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:38.694616 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.694303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7976ea-0897-4d88-941a-1daea881c234-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.697416 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.696485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6kvb\" (UniqueName: \"kubernetes.io/projected/3c7976ea-0897-4d88-941a-1daea881c234-kube-api-access-m6kvb\") pod \"service-ca-operator-5d6c75f84f-jfh96\" (UID: \"3c7976ea-0897-4d88-941a-1daea881c234\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.707951 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.707882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzc4x\" (UniqueName: \"kubernetes.io/projected/5a9f93fe-59e9-4302-b9cc-7babf7039c06-kube-api-access-vzc4x\") pod \"network-check-source-7d88cb55d8-2xfbq\" (UID: \"5a9f93fe-59e9-4302-b9cc-7babf7039c06\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"
Jul 29 02:35:38.719759 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.719362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcnm\" (UniqueName: \"kubernetes.io/projected/164f6f46-c328-4c86-9b9b-8c640b30743e-kube-api-access-trcnm\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:38.753175 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.751145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-lc687"]
Jul 29 02:35:38.754854 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:38.754818    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a747d4e_0878_4732_8e2a_18e8c8c955b8.slice/crio-6836f32e23acf1b31d73acb96228d3b2fae5903a37b709aabdb8d26e8e75bb6c WatchSource:0}: Error finding container 6836f32e23acf1b31d73acb96228d3b2fae5903a37b709aabdb8d26e8e75bb6c: Status 404 returned error can't find the container with id 6836f32e23acf1b31d73acb96228d3b2fae5903a37b709aabdb8d26e8e75bb6c
Jul 29 02:35:38.773083 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.769223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"
Jul 29 02:35:38.788945 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.788375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"
Jul 29 02:35:38.815269 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.815224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s"]
Jul 29 02:35:38.819923 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:38.819893    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode904d051_def7_468b_85e5_5aa470c9c79b.slice/crio-c70ec122fe3c8016c84ede7a1b26c769c891fa518f7f86336c7e7315ab447681 WatchSource:0}: Error finding container c70ec122fe3c8016c84ede7a1b26c769c891fa518f7f86336c7e7315ab447681: Status 404 returned error can't find the container with id c70ec122fe3c8016c84ede7a1b26c769c891fa518f7f86336c7e7315ab447681
Jul 29 02:35:38.848464 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.848424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-l9tw4"]
Jul 29 02:35:38.851978 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:38.851943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01daba41_2f6a_4416_a2d5_b5ecea850aa2.slice/crio-9721119a9173e8cbd3e69676929602f79a82aa2c7672cc27c0321403984b0e30 WatchSource:0}: Error finding container 9721119a9173e8cbd3e69676929602f79a82aa2c7672cc27c0321403984b0e30: Status 404 returned error can't find the container with id 9721119a9173e8cbd3e69676929602f79a82aa2c7672cc27c0321403984b0e30
Jul 29 02:35:38.882110 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.882072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d"]
Jul 29 02:35:38.888080 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:38.887953    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4686e8_c644_4409_9b9a_56d2bf89cb3a.slice/crio-7d132172367700565419b14db0911433bd364978a1314d795b1db3b54b148e7e WatchSource:0}: Error finding container 7d132172367700565419b14db0911433bd364978a1314d795b1db3b54b148e7e: Status 404 returned error can't find the container with id 7d132172367700565419b14db0911433bd364978a1314d795b1db3b54b148e7e
Jul 29 02:35:38.996880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:38.996844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:38.997072 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.997017    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:38.997123 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:38.997098    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:39.997077271 +0000 UTC m=+38.031793961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:39.046963 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.046924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq"]
Jul 29 02:35:39.052119 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:39.052084    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9f93fe_59e9_4302_b9cc_7babf7039c06.slice/crio-ecd2d487f6292d3622dbed83eacb964df58ca3fae50561f93e8930ac9f7ae72e WatchSource:0}: Error finding container ecd2d487f6292d3622dbed83eacb964df58ca3fae50561f93e8930ac9f7ae72e: Status 404 returned error can't find the container with id ecd2d487f6292d3622dbed83eacb964df58ca3fae50561f93e8930ac9f7ae72e
Jul 29 02:35:39.097944 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.097911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:39.098142 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.098000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:39.098142 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:39.098064    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:39.098142 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:39.098128    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:40.098114412 +0000 UTC m=+38.132831083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:39.098277 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:39.098148    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:40.098134838 +0000 UTC m=+38.132851505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:39.163333 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.163296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96"]
Jul 29 02:35:39.166126 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:35:39.166098    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7976ea_0897_4d88_941a_1daea881c234.slice/crio-5d3488bc2620825abb74c7e643a12a43ecaddb3890b19221424883840c09bc85 WatchSource:0}: Error finding container 5d3488bc2620825abb74c7e643a12a43ecaddb3890b19221424883840c09bc85: Status 404 returned error can't find the container with id 5d3488bc2620825abb74c7e643a12a43ecaddb3890b19221424883840c09bc85
Jul 29 02:35:39.199101 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.199061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:39.199300 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:39.199232    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:39.199367 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:39.199322    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:35:40.199306225 +0000 UTC m=+38.234022892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:39.571515 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.571469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-l9tw4" event={"ID":"01daba41-2f6a-4416-a2d5-b5ecea850aa2","Type":"ContainerStarted","Data":"9721119a9173e8cbd3e69676929602f79a82aa2c7672cc27c0321403984b0e30"}
Jul 29 02:35:39.573029 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.572996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d" event={"ID":"1a4686e8-c644-4409-9b9a-56d2bf89cb3a","Type":"ContainerStarted","Data":"7d132172367700565419b14db0911433bd364978a1314d795b1db3b54b148e7e"}
Jul 29 02:35:39.574385 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.574343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" event={"ID":"7a747d4e-0878-4732-8e2a-18e8c8c955b8","Type":"ContainerStarted","Data":"6836f32e23acf1b31d73acb96228d3b2fae5903a37b709aabdb8d26e8e75bb6c"}
Jul 29 02:35:39.578904 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.578825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" event={"ID":"63dd1e50-95f4-4e85-87e8-6ea09cea9d35","Type":"ContainerStarted","Data":"9f842dc84256100c64bbdada244edbd230828b75a04ef6bd6ca6516e3091ff40"}
Jul 29 02:35:39.580351 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.580300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s" event={"ID":"e904d051-def7-468b-85e5-5aa470c9c79b","Type":"ContainerStarted","Data":"c70ec122fe3c8016c84ede7a1b26c769c891fa518f7f86336c7e7315ab447681"}
Jul 29 02:35:39.581721 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.581691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq" event={"ID":"5a9f93fe-59e9-4302-b9cc-7babf7039c06","Type":"ContainerStarted","Data":"ecd2d487f6292d3622dbed83eacb964df58ca3fae50561f93e8930ac9f7ae72e"}
Jul 29 02:35:39.583155 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.583125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96" event={"ID":"3c7976ea-0897-4d88-941a-1daea881c234","Type":"ContainerStarted","Data":"5d3488bc2620825abb74c7e643a12a43ecaddb3890b19221424883840c09bc85"}
Jul 29 02:35:39.600211 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.600158    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2wcgm" podStartSLOduration=19.552275189 podStartE2EDuration="37.60013421s" totalImagesPullingTime="18.047859021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:39.598426707 +0000 UTC m=+37.633143426" watchObservedRunningTime="2026-07-29 02:35:39.60013421 +0000 UTC m=+37.634850902"
Jul 29 02:35:39.692300 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.692261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:39.744588 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:39.744539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:40.007167 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.007117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:40.007363 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.007329    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:40.007429 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.007409    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:42.007387408 +0000 UTC m=+40.042104089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:40.108128 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.108096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:40.108299 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.108231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:40.108357 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.108317    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:42.108292287 +0000 UTC m=+40.143008972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:40.108433 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.108354    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:40.108433 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.108417    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:42.108402619 +0000 UTC m=+40.143119290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:40.209520 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.209482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:40.209686 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.209660    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:40.209743 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.209732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:35:42.209717818 +0000 UTC m=+40.244434486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:40.592212 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.592020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wst4g" event={"ID":"778c18ab-e223-42e4-aa27-eebba3ec33df","Type":"ContainerStarted","Data":"bd21283f79ffe0cea8e80d853adaa868865b4d619de5fd66426603e2e233494c"}
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.615098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:40.615289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.615438    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.615465    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.615489    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.615510    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:35:44.615489512 +0000 UTC m=+42.650206182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:40.615877 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:40.615546    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:44.615528384 +0000 UTC m=+42.650245071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:42.031121 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.031047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:42.031594 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.031197    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:42.031594 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.031297    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:46.031274127 +0000 UTC m=+44.065990799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:42.132533 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.132488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:42.132722 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.132626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:42.132791 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.132771    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:42.132861 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.132849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:46.132827332 +0000 UTC m=+44.167544016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:42.133320 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.133298    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:46.133279012 +0000 UTC m=+44.167995681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:42.233741 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.233701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:42.233913 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.233893    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:42.233992 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:42.233980    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:35:46.233957862 +0000 UTC m=+44.268674533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:42.379379 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.378606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:42.479670 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:42.479589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:44.656507 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:44.656463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:44.656581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:44.656631    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:44.656653    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:44.656688    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:44.656715    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:52.656699144 +0000 UTC m=+50.691415813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:44.656902 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:44.656736    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:35:52.656724643 +0000 UTC m=+50.691441311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:45.608575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.608537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-l9tw4" event={"ID":"01daba41-2f6a-4416-a2d5-b5ecea850aa2","Type":"ContainerStarted","Data":"37ff8689abef089fd2fe74c0f3863096c2189cf559cc8b64f88f98e1feaed8e5"}
Jul 29 02:35:45.610551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.610466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" event={"ID":"7a747d4e-0878-4732-8e2a-18e8c8c955b8","Type":"ContainerStarted","Data":"47c45b9d3cf995f33e47c2b345e751dd5053da45362ec9fff421b5fd0391d7ec"}
Jul 29 02:35:45.611457 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.610949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:45.612405 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.612370    2560 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-lc687 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" start-of-body=
Jul 29 02:35:45.612510 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.612431    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podUID="7a747d4e-0878-4732-8e2a-18e8c8c955b8" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused"
Jul 29 02:35:45.631270 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.631203    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podStartSLOduration=0.940097256 podStartE2EDuration="7.63118657s" totalImagesPullingTime="6.691089314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:45.631039591 +0000 UTC m=+43.665756280" watchObservedRunningTime="2026-07-29 02:35:45.63118657 +0000 UTC m=+43.665903253"
Jul 29 02:35:45.632219 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:45.632179    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wst4g" podStartSLOduration=6.756850685 podStartE2EDuration="9.63216566s" totalImagesPullingTime="2.875314975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:40.608684216 +0000 UTC m=+38.643400905" watchObservedRunningTime="2026-07-29 02:35:45.63216566 +0000 UTC m=+43.666882349"
Jul 29 02:35:46.068109 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.067491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:46.068109 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.067670    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:46.068109 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.067735    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.067714955 +0000 UTC m=+52.102431636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:46.168561 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.168508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:46.168765 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.168636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:46.168765 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.168683    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:46.168765 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.168759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.168738291 +0000 UTC m=+52.203454964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:46.168909 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.168823    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.168804504 +0000 UTC m=+52.203521187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:46.270148 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.270100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:46.270379 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.270296    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:46.270379 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:46.270376    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.270356118 +0000 UTC m=+52.305072792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:46.616362 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.616267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq" event={"ID":"5a9f93fe-59e9-4302-b9cc-7babf7039c06","Type":"ContainerStarted","Data":"fe16272c57edd5a835727772bd8a1befb072253e5f251a10f22b566b2f20ab08"}
Jul 29 02:35:46.617944 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.617913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96" event={"ID":"3c7976ea-0897-4d88-941a-1daea881c234","Type":"ContainerStarted","Data":"c139b6bcc28461d5ba73794e13c1fd6873596255ed061f245117e26b95ec8746"}
Jul 29 02:35:46.619609 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.619549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d" event={"ID":"1a4686e8-c644-4409-9b9a-56d2bf89cb3a","Type":"ContainerStarted","Data":"cd58ae3018db2bbc9892c5ca48efbfc67fc5fbdace6cafc0c4844979128cf167"}
Jul 29 02:35:46.621053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.621033    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/0.log"
Jul 29 02:35:46.621402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.621073    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a747d4e-0878-4732-8e2a-18e8c8c955b8" containerID="47c45b9d3cf995f33e47c2b345e751dd5053da45362ec9fff421b5fd0391d7ec" exitCode=255
Jul 29 02:35:46.621402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.621152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" event={"ID":"7a747d4e-0878-4732-8e2a-18e8c8c955b8","Type":"ContainerDied","Data":"47c45b9d3cf995f33e47c2b345e751dd5053da45362ec9fff421b5fd0391d7ec"}
Jul 29 02:35:46.621402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.621322    2560 scope.go:117] "RemoveContainer" containerID="47c45b9d3cf995f33e47c2b345e751dd5053da45362ec9fff421b5fd0391d7ec"
Jul 29 02:35:46.624097 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.624072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s" event={"ID":"e904d051-def7-468b-85e5-5aa470c9c79b","Type":"ContainerStarted","Data":"c64b37cc9a9a1a5658c8d7318c96e379e7b5862928310bcbbb70659f034d5428"}
Jul 29 02:35:46.636793 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.635799    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2xfbq" podStartSLOduration=2.23934473 podStartE2EDuration="8.635776427s" totalImagesPullingTime="6.396431697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.634773109 +0000 UTC m=+44.669489788" watchObservedRunningTime="2026-07-29 02:35:46.635776427 +0000 UTC m=+44.670493118"
Jul 29 02:35:46.655123 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.655073    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-l9tw4" podStartSLOduration=2.059615639 podStartE2EDuration="8.655050931s" totalImagesPullingTime="6.595435292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.654296671 +0000 UTC m=+44.689013364" watchObservedRunningTime="2026-07-29 02:35:46.655050931 +0000 UTC m=+44.689767629"
Jul 29 02:35:46.699359 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.699298    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96" podStartSLOduration=1.942545601 podStartE2EDuration="8.699274671s" totalImagesPullingTime="6.75672907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.69875572 +0000 UTC m=+44.733472398" watchObservedRunningTime="2026-07-29 02:35:46.699274671 +0000 UTC m=+44.733991368"
Jul 29 02:35:46.700329 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.700289    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nld9d" podStartSLOduration=2.14087131 podStartE2EDuration="8.700277343s" totalImagesPullingTime="6.559406033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.678729838 +0000 UTC m=+44.713446527" watchObservedRunningTime="2026-07-29 02:35:46.700277343 +0000 UTC m=+44.734994032"
Jul 29 02:35:46.740738 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:46.740667    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s" podStartSLOduration=2.112932004 podStartE2EDuration="8.740642103s" totalImagesPullingTime="6.627710099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.739239272 +0000 UTC m=+44.773955968" watchObservedRunningTime="2026-07-29 02:35:46.740642103 +0000 UTC m=+44.775358793"
Jul 29 02:35:47.057893 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.056440    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfnd"]
Jul 29 02:35:47.073684 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.073650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.074640 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.074610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfnd"]
Jul 29 02:35:47.076860 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.076836    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6stpf\""
Jul 29 02:35:47.077028 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.076838    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 02:35:47.077310 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.076838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 02:35:47.186788 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.186734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2dnw\" (UniqueName: \"kubernetes.io/projected/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-api-access-c2dnw\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.186788 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.186789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-crio-socket\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.187013 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.186887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.187013 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.186928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.187013 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.186979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-data-volume\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288381 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288564 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288564 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-data-volume\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288564 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.288480    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:47.288564 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.288536    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 02:35:47.288564 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.288552    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:47.788532481 +0000 UTC m=+45.823249149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:47.288752 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2dnw\" (UniqueName: \"kubernetes.io/projected/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-api-access-c2dnw\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288752 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.288597    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:47.788579584 +0000 UTC m=+45.823296266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : configmap "kube-rbac-proxy" not found
Jul 29 02:35:47.288752 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-crio-socket\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288842 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-crio-socket\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.288980 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.288959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-data-volume\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.298235 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.298197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2dnw\" (UniqueName: \"kubernetes.io/projected/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-api-access-c2dnw\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.630647 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.630615    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:35:47.631203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.631179    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/0.log"
Jul 29 02:35:47.631321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.631236    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a747d4e-0878-4732-8e2a-18e8c8c955b8" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399" exitCode=255
Jul 29 02:35:47.631376 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.631345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" event={"ID":"7a747d4e-0878-4732-8e2a-18e8c8c955b8","Type":"ContainerDied","Data":"21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"}
Jul 29 02:35:47.645934 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.645895    2560 scope.go:117] "RemoveContainer" containerID="47c45b9d3cf995f33e47c2b345e751dd5053da45362ec9fff421b5fd0391d7ec"
Jul 29 02:35:47.646106 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.646021    2560 scope.go:117] "RemoveContainer" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"
Jul 29 02:35:47.646318 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.646295    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-lc687_openshift-console-operator(7a747d4e-0878-4732-8e2a-18e8c8c955b8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podUID="7a747d4e-0878-4732-8e2a-18e8c8c955b8"
Jul 29 02:35:47.793029 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.792989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.793274 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.793142    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 02:35:47.793274 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:47.793198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:47.793274 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.793235    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:48.793213137 +0000 UTC m=+46.827929822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : configmap "kube-rbac-proxy" not found
Jul 29 02:35:47.793449 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.793320    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:47.793449 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:47.793372    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:48.793361437 +0000 UTC m=+46.828078109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:48.561404 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:48.561363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:48.636177 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:48.636148    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:35:48.636576 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:48.636557    2560 scope.go:117] "RemoveContainer" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"
Jul 29 02:35:48.636772 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:48.636750    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-lc687_openshift-console-operator(7a747d4e-0878-4732-8e2a-18e8c8c955b8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podUID="7a747d4e-0878-4732-8e2a-18e8c8c955b8"
Jul 29 02:35:48.802272 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:48.802203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:48.802458 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:48.802285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:48.802458 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:48.802347    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:48.802458 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:48.802395    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 02:35:48.802458 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:48.802411    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:50.802394263 +0000 UTC m=+48.837110933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:48.802458 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:48.802448    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:50.802435517 +0000 UTC m=+48.837152184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : configmap "kube-rbac-proxy" not found
Jul 29 02:35:49.639265 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:49.639227    2560 scope.go:117] "RemoveContainer" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"
Jul 29 02:35:49.639734 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:49.639404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-lc687_openshift-console-operator(7a747d4e-0878-4732-8e2a-18e8c8c955b8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podUID="7a747d4e-0878-4732-8e2a-18e8c8c955b8"
Jul 29 02:35:49.679993 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:49.679965    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hq6x5_5091c187-14d2-4ebb-b931-49cb63365f28/dns-node-resolver/0.log"
Jul 29 02:35:50.477723 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:50.477693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrkjw_5f39cb20-4dbb-49f1-a882-7706c7db1259/node-ca/0.log"
Jul 29 02:35:50.818180 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:50.818082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:50.818180 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:50.818139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:50.818634 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:50.818201    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 02:35:50.818634 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:50.818233    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:50.818634 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:50.818308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.818292589 +0000 UTC m=+52.853009257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:50.818634 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:50.818375    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.818366263 +0000 UTC m=+52.853082931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : configmap "kube-rbac-proxy" not found
Jul 29 02:35:51.277871 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:51.277809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wst4g_778c18ab-e223-42e4-aa27-eebba3ec33df/serve-healthcheck-canary/0.log"
Jul 29 02:35:51.879573 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:51.879525    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z282s_e904d051-def7-468b-85e5-5aa470c9c79b/kube-storage-version-migrator-operator/0.log"
Jul 29 02:35:52.734807 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:52.734769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:35:52.735005 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:52.734904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:35:52.735005 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:52.734918    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 02:35:52.735005 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:52.734936    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d986665d8-mflgl: secret "image-registry-tls" not found
Jul 29 02:35:52.735005 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:52.734986    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls podName:04b2493e-6ce5-48f3-8393-8d17ba162e43 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:08.734969471 +0000 UTC m=+66.769686139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls") pod "image-registry-6d986665d8-mflgl" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43") : secret "image-registry-tls" not found
Jul 29 02:35:52.735005 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:52.735002    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 02:35:52.735171 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:52.735050    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls podName:78da0e9a-4047-4386-b822-31cb5f3b709f nodeName:}" failed. No retries permitted until 2026-07-29 02:36:08.735033069 +0000 UTC m=+66.769749737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls") pod "dns-default-8pjnm" (UID: "78da0e9a-4047-4386-b822-31cb5f3b709f") : secret "dns-default-metrics-tls" not found
Jul 29 02:35:54.147789 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.147741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:35:54.148187 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.147892    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:54.148187 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.147974    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls podName:f497a683-8dce-456e-9940-3a9728fb3c5b nodeName:}" failed. No retries permitted until 2026-07-29 02:36:10.14795792 +0000 UTC m=+68.182674588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-46nbd" (UID: "f497a683-8dce-456e-9940-3a9728fb3c5b") : secret "cluster-monitoring-operator-tls" not found
Jul 29 02:35:54.248977 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.248934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:54.249152 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.249034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:35:54.249152 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.249091    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 02:35:54.249218 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.249160    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:10.249144884 +0000 UTC m=+68.283861552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : secret "router-metrics-certs-default" not found
Jul 29 02:35:54.249218 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.249194    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle podName:f4304694-f029-4ca7-b683-7c37bf5b4429 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:10.249181021 +0000 UTC m=+68.283897692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle") pod "router-default-54f7bcd7cf-nm5fw" (UID: "f4304694-f029-4ca7-b683-7c37bf5b4429") : configmap references non-existent config key: service-ca.crt
Jul 29 02:35:54.349910 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.349864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:35:54.350086 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.350019    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 02:35:54.350086 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.350083    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls podName:164f6f46-c328-4c86-9b9b-8c640b30743e nodeName:}" failed. No retries permitted until 2026-07-29 02:36:10.350068457 +0000 UTC m=+68.384785124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls") pod "cluster-samples-operator-6748489656-rk8jx" (UID: "164f6f46-c328-4c86-9b9b-8c640b30743e") : secret "samples-operator-tls" not found
Jul 29 02:35:54.855256 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.855208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:54.855479 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.855272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:54.855479 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.855383    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:54.855479 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:54.855469    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls podName:2cd022d7-bd48-44a5-ac54-2523a2ef9ba9 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:02.855447497 +0000 UTC m=+60.890164180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xfnd" (UID: "2cd022d7-bd48-44a5-ac54-2523a2ef9ba9") : secret "insights-runtime-extractor-tls" not found
Jul 29 02:35:54.855806 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:54.855774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:35:55.611105 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:55.611061    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:35:55.611604 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:35:55.611499    2560 scope.go:117] "RemoveContainer" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"
Jul 29 02:35:55.611678 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:35:55.611655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-lc687_openshift-console-operator(7a747d4e-0878-4732-8e2a-18e8c8c955b8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" podUID="7a747d4e-0878-4732-8e2a-18e8c8c955b8"
Jul 29 02:36:02.932390 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:02.932342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:36:02.934569 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:02.934546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd022d7-bd48-44a5-ac54-2523a2ef9ba9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfnd\" (UID: \"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9\") " pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:36:02.987579 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:02.987549    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6stpf\""
Jul 29 02:36:02.995807 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:02.995773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xfnd"
Jul 29 02:36:03.121734 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:03.121710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfnd"]
Jul 29 02:36:03.124288 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:03.124240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd022d7_bd48_44a5_ac54_2523a2ef9ba9.slice/crio-65e32ac24448f54db4a003b73ed82451048cd9a4d4a45ef999e8f3b608b2f2b8 WatchSource:0}: Error finding container 65e32ac24448f54db4a003b73ed82451048cd9a4d4a45ef999e8f3b608b2f2b8: Status 404 returned error can't find the container with id 65e32ac24448f54db4a003b73ed82451048cd9a4d4a45ef999e8f3b608b2f2b8
Jul 29 02:36:03.684889 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:03.684846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfnd" event={"ID":"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9","Type":"ContainerStarted","Data":"65e32ac24448f54db4a003b73ed82451048cd9a4d4a45ef999e8f3b608b2f2b8"}
Jul 29 02:36:04.558111 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:04.558077    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v97ng"
Jul 29 02:36:08.083288 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.083226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:36:08.086685 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.086661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 02:36:08.096173 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.096143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bebd31d-8134-4583-8ad5-97814390926a-original-pull-secret\") pod \"global-pull-secret-syncer-mb46c\" (UID: \"5bebd31d-8134-4583-8ad5-97814390926a\") " pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:36:08.120485 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.120448    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mb46c"
Jul 29 02:36:08.184022 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.183985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:36:08.184176 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.184091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:36:08.186553 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.186492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrs6\" (UniqueName: \"kubernetes.io/projected/657f5ec0-07c9-423c-aae8-a2bd56b87076-kube-api-access-9lrs6\") pod \"network-check-target-46kkw\" (UID: \"657f5ec0-07c9-423c-aae8-a2bd56b87076\") " pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:36:08.186871 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.186851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 02:36:08.197449 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.197395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fceadac6-9c8c-422e-990b-3af17d36c589-metrics-certs\") pod \"network-metrics-daemon-29x8f\" (UID: \"fceadac6-9c8c-422e-990b-3af17d36c589\") " pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:36:08.256576 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.256487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mb46c"]
Jul 29 02:36:08.258971 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:08.258943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bebd31d_8134_4583_8ad5_97814390926a.slice/crio-67b80be4a661af451705993c7c277ec595d87cf4eff390134e828d3600906cde WatchSource:0}: Error finding container 67b80be4a661af451705993c7c277ec595d87cf4eff390134e828d3600906cde: Status 404 returned error can't find the container with id 67b80be4a661af451705993c7c277ec595d87cf4eff390134e828d3600906cde
Jul 29 02:36:08.314810 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.314778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngnfs\""
Jul 29 02:36:08.323067 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.323040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:36:08.402952 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.402922    2560 scope.go:117] "RemoveContainer" containerID="21da3a9c295525bb3db8a409b0aea84cee6bc2baf869fd7b1927fa7efcf66399"
Jul 29 02:36:08.416377 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.416348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2t7w\""
Jul 29 02:36:08.424498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.424470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29x8f"
Jul 29 02:36:08.444745 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.444708    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"]
Jul 29 02:36:08.457604 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.457573    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"]
Jul 29 02:36:08.457735 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.457712    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.460694 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.460663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 02:36:08.462044 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.462008    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 02:36:08.462184 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.462058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 02:36:08.462184 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.462058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8f6m5\""
Jul 29 02:36:08.462184 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.462202    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 02:36:08.478187 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.478156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"]
Jul 29 02:36:08.478390 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.478198    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"]
Jul 29 02:36:08.478390 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.478307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.480890 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.480867    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tppff\""
Jul 29 02:36:08.481053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.480915    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 02:36:08.481053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.480965    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 02:36:08.589134 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.589046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhfz7\" (UniqueName: \"kubernetes.io/projected/8130e49d-e855-4419-a90e-b3dc78912598-kube-api-access-lhfz7\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.589294 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.589136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.589294 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.589170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.589426 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.589324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8130e49d-e855-4419-a90e-b3dc78912598-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.642807 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.642778    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29x8f"]
Jul 29 02:36:08.644818 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:08.644777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceadac6_9c8c_422e_990b_3af17d36c589.slice/crio-8e64164f5ba476764e5394cbbf23340f3df9beb1df55fa8dfbe088532bc8d328 WatchSource:0}: Error finding container 8e64164f5ba476764e5394cbbf23340f3df9beb1df55fa8dfbe088532bc8d328: Status 404 returned error can't find the container with id 8e64164f5ba476764e5394cbbf23340f3df9beb1df55fa8dfbe088532bc8d328
Jul 29 02:36:08.662481 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.662065    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46kkw"]
Jul 29 02:36:08.665801 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:08.665754    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657f5ec0_07c9_423c_aae8_a2bd56b87076.slice/crio-85f065c09b53afd5ed7970f85b5fefaf9d84de2a0fec36e768a1d26c7a15e70a WatchSource:0}: Error finding container 85f065c09b53afd5ed7970f85b5fefaf9d84de2a0fec36e768a1d26c7a15e70a: Status 404 returned error can't find the container with id 85f065c09b53afd5ed7970f85b5fefaf9d84de2a0fec36e768a1d26c7a15e70a
Jul 29 02:36:08.690537 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.690497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhfz7\" (UniqueName: \"kubernetes.io/projected/8130e49d-e855-4419-a90e-b3dc78912598-kube-api-access-lhfz7\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.690736 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.690592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.690736 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.690627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.690862 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.690759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8130e49d-e855-4419-a90e-b3dc78912598-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.691436 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.691410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.693517 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.693500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8c8728-ec25-4ae7-ba7c-c80c12bb671b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c2rhv\" (UID: \"de8c8728-ec25-4ae7-ba7c-c80c12bb671b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.693758 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.693739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8130e49d-e855-4419-a90e-b3dc78912598-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.698702 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.698679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhfz7\" (UniqueName: \"kubernetes.io/projected/8130e49d-e855-4419-a90e-b3dc78912598-kube-api-access-lhfz7\") pod \"managed-serviceaccount-addon-agent-5868bc9764-dtgwj\" (UID: \"8130e49d-e855-4419-a90e-b3dc78912598\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.703915 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.703894    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:36:08.704019 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.703979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-lc687" event={"ID":"7a747d4e-0878-4732-8e2a-18e8c8c955b8","Type":"ContainerStarted","Data":"ad59ead43a997f9b64a9344ce41913d2b393234c761bfc7996aa3877f2dccc35"}
Jul 29 02:36:08.704616 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.704357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:36:08.705180 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.705155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46kkw" event={"ID":"657f5ec0-07c9-423c-aae8-a2bd56b87076","Type":"ContainerStarted","Data":"85f065c09b53afd5ed7970f85b5fefaf9d84de2a0fec36e768a1d26c7a15e70a"}
Jul 29 02:36:08.706423 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.706404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29x8f" event={"ID":"fceadac6-9c8c-422e-990b-3af17d36c589","Type":"ContainerStarted","Data":"8e64164f5ba476764e5394cbbf23340f3df9beb1df55fa8dfbe088532bc8d328"}
Jul 29 02:36:08.707600 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.707582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mb46c" event={"ID":"5bebd31d-8134-4583-8ad5-97814390926a","Type":"ContainerStarted","Data":"67b80be4a661af451705993c7c277ec595d87cf4eff390134e828d3600906cde"}
Jul 29 02:36:08.708957 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.708939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfnd" event={"ID":"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9","Type":"ContainerStarted","Data":"c82ac96f5f1a6c7352fb304cd9fee8cb5eb30c4eb108de9f982e5af68e994a62"}
Jul 29 02:36:08.780489 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.780450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"
Jul 29 02:36:08.788896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.788869    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"
Jul 29 02:36:08.791312 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.791291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:08.791630 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.791610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:36:08.793643 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.793623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"image-registry-6d986665d8-mflgl\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") " pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:08.793794 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.793775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78da0e9a-4047-4386-b822-31cb5f3b709f-metrics-tls\") pod \"dns-default-8pjnm\" (UID: \"78da0e9a-4047-4386-b822-31cb5f3b709f\") " pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:36:08.938557 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.937911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj"]
Jul 29 02:36:08.939059 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:08.939026    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8130e49d_e855_4419_a90e_b3dc78912598.slice/crio-2376d3af2da5f5e905b31c53cbf1d99b567473d765e816f9ed71c273b9c51f52 WatchSource:0}: Error finding container 2376d3af2da5f5e905b31c53cbf1d99b567473d765e816f9ed71c273b9c51f52: Status 404 returned error can't find the container with id 2376d3af2da5f5e905b31c53cbf1d99b567473d765e816f9ed71c273b9c51f52
Jul 29 02:36:08.976965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.976914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv"]
Jul 29 02:36:08.980116 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:08.980055    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8c8728_ec25_4ae7_ba7c_c80c12bb671b.slice/crio-ca9817d196af0e4b803eb8da74bc46f441385cad8b41fd37b44e9a192eae3a98 WatchSource:0}: Error finding container ca9817d196af0e4b803eb8da74bc46f441385cad8b41fd37b44e9a192eae3a98: Status 404 returned error can't find the container with id ca9817d196af0e4b803eb8da74bc46f441385cad8b41fd37b44e9a192eae3a98
Jul 29 02:36:08.985191 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.984995    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9hmnf\""
Jul 29 02:36:08.993751 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.993722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:08.994230 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:08.994206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdc6x\""
Jul 29 02:36:09.001665 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.001484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:36:09.190093 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.190010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:36:09.202019 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:09.201904    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b2493e_6ce5_48f3_8393_8d17ba162e43.slice/crio-13c105f8c82d4205dd19b96ac24af2a2229b98b528d65660f071ef7e1145cbea WatchSource:0}: Error finding container 13c105f8c82d4205dd19b96ac24af2a2229b98b528d65660f071ef7e1145cbea: Status 404 returned error can't find the container with id 13c105f8c82d4205dd19b96ac24af2a2229b98b528d65660f071ef7e1145cbea
Jul 29 02:36:09.211578 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.211504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pjnm"]
Jul 29 02:36:09.490293 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.490037    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-lc687"
Jul 29 02:36:09.724291 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.723973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46kkw" event={"ID":"657f5ec0-07c9-423c-aae8-a2bd56b87076","Type":"ContainerStarted","Data":"05ff27f4237eb557ba361adfe6852e8044c5fd7c79d35a3c5012b05f7ee67ee0"}
Jul 29 02:36:09.724487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.724377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:36:09.731095 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.731053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv" event={"ID":"de8c8728-ec25-4ae7-ba7c-c80c12bb671b","Type":"ContainerStarted","Data":"ca9817d196af0e4b803eb8da74bc46f441385cad8b41fd37b44e9a192eae3a98"}
Jul 29 02:36:09.734497 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.734413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pjnm" event={"ID":"78da0e9a-4047-4386-b822-31cb5f3b709f","Type":"ContainerStarted","Data":"6382d07f87ef22609520a4a919c92fa3c939cba260d0d313740063a19c50e2cd"}
Jul 29 02:36:09.738351 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.738316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" event={"ID":"04b2493e-6ce5-48f3-8393-8d17ba162e43","Type":"ContainerStarted","Data":"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"}
Jul 29 02:36:09.738642 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.738621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" event={"ID":"04b2493e-6ce5-48f3-8393-8d17ba162e43","Type":"ContainerStarted","Data":"13c105f8c82d4205dd19b96ac24af2a2229b98b528d65660f071ef7e1145cbea"}
Jul 29 02:36:09.738814 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.738802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:09.740727 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.740638    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-46kkw" podStartSLOduration=67.74062038 podStartE2EDuration="1m7.74062038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:09.740151071 +0000 UTC m=+67.774867761" watchObservedRunningTime="2026-07-29 02:36:09.74062038 +0000 UTC m=+67.775337068"
Jul 29 02:36:09.741501 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.741188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj" event={"ID":"8130e49d-e855-4419-a90e-b3dc78912598","Type":"ContainerStarted","Data":"2376d3af2da5f5e905b31c53cbf1d99b567473d765e816f9ed71c273b9c51f52"}
Jul 29 02:36:09.764422 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:09.764360    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" podStartSLOduration=66.764335999 podStartE2EDuration="1m6.764335999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:09.763776153 +0000 UTC m=+67.798492860" watchObservedRunningTime="2026-07-29 02:36:09.764335999 +0000 UTC m=+67.799052687"
Jul 29 02:36:10.208101 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.207893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:36:10.212345 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.212283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f497a683-8dce-456e-9940-3a9728fb3c5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-46nbd\" (UID: \"f497a683-8dce-456e-9940-3a9728fb3c5b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:36:10.310822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.309493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:10.310822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.309604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:10.310822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.310766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4304694-f029-4ca7-b683-7c37bf5b4429-service-ca-bundle\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:10.312657 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.312604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4304694-f029-4ca7-b683-7c37bf5b4429-metrics-certs\") pod \"router-default-54f7bcd7cf-nm5fw\" (UID: \"f4304694-f029-4ca7-b683-7c37bf5b4429\") " pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:10.348161 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.348124    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nw56l\""
Jul 29 02:36:10.356602 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.356364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"
Jul 29 02:36:10.410819 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.410278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:36:10.419342 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.419270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/164f6f46-c328-4c86-9b9b-8c640b30743e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rk8jx\" (UID: \"164f6f46-c328-4c86-9b9b-8c640b30743e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:36:10.448653 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.448618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lhxjz\""
Jul 29 02:36:10.456990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.456953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:10.553490 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.553454    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t4jbd\""
Jul 29 02:36:10.561683 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.561644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"
Jul 29 02:36:10.933897 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.933630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx"]
Jul 29 02:36:10.961732 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.961575    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd"]
Jul 29 02:36:10.968875 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:10.968735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f7bcd7cf-nm5fw"]
Jul 29 02:36:10.981107 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:10.981050    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4304694_f029_4ca7_b683_7c37bf5b4429.slice/crio-fa57740f5c62885bd4e8f710591bce45c15c476aac6c3e040de7f607db72c770 WatchSource:0}: Error finding container fa57740f5c62885bd4e8f710591bce45c15c476aac6c3e040de7f607db72c770: Status 404 returned error can't find the container with id fa57740f5c62885bd4e8f710591bce45c15c476aac6c3e040de7f607db72c770
Jul 29 02:36:10.985750 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:10.985482    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf497a683_8dce_456e_9940_3a9728fb3c5b.slice/crio-473f7e97787b8c896935f5f5e7e221ba8a3d3f0edafebb952b53285740db6e45 WatchSource:0}: Error finding container 473f7e97787b8c896935f5f5e7e221ba8a3d3f0edafebb952b53285740db6e45: Status 404 returned error can't find the container with id 473f7e97787b8c896935f5f5e7e221ba8a3d3f0edafebb952b53285740db6e45
Jul 29 02:36:11.755240 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.754430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv" event={"ID":"de8c8728-ec25-4ae7-ba7c-c80c12bb671b","Type":"ContainerStarted","Data":"db0a0814d1202915d673b7cf56df3857b66ce8379a1712715ea31302ed4b0655"}
Jul 29 02:36:11.758132 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.758045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx" event={"ID":"164f6f46-c328-4c86-9b9b-8c640b30743e","Type":"ContainerStarted","Data":"f68adf433c026c4952b3a675eaa195d62d16f3680a3c3a61a1ab0d694bfa27e5"}
Jul 29 02:36:11.762415 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.762238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29x8f" event={"ID":"fceadac6-9c8c-422e-990b-3af17d36c589","Type":"ContainerStarted","Data":"3eecd9b897553f5a775e7b8109b696c8ad35c4cd007ca1b2a28911f633c3c69e"}
Jul 29 02:36:11.762415 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.762326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29x8f" event={"ID":"fceadac6-9c8c-422e-990b-3af17d36c589","Type":"ContainerStarted","Data":"03d87912e6a2a882dc387dc1a203a83e48a5c681f1df69e89c2b6fa9bf33b860"}
Jul 29 02:36:11.765552 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.764933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw" event={"ID":"f4304694-f029-4ca7-b683-7c37bf5b4429","Type":"ContainerStarted","Data":"02115ac9a0b62718fe11feab962519c8e6a46803be51b2d4df6d511b4c2cf694"}
Jul 29 02:36:11.765552 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.764988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw" event={"ID":"f4304694-f029-4ca7-b683-7c37bf5b4429","Type":"ContainerStarted","Data":"fa57740f5c62885bd4e8f710591bce45c15c476aac6c3e040de7f607db72c770"}
Jul 29 02:36:11.767856 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.767822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd" event={"ID":"f497a683-8dce-456e-9940-3a9728fb3c5b","Type":"ContainerStarted","Data":"473f7e97787b8c896935f5f5e7e221ba8a3d3f0edafebb952b53285740db6e45"}
Jul 29 02:36:11.771079 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.770863    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c2rhv" podStartSLOduration=2.013798423 podStartE2EDuration="3.770840083s" totalImagesPullingTime="1.75704166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:11.769101547 +0000 UTC m=+69.803818238" watchObservedRunningTime="2026-07-29 02:36:11.770840083 +0000 UTC m=+69.805556772"
Jul 29 02:36:11.789446 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.789381    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw" podStartSLOduration=33.789358859000004 podStartE2EDuration="33.789358859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:11.788760993 +0000 UTC m=+69.823477716" watchObservedRunningTime="2026-07-29 02:36:11.789358859 +0000 UTC m=+69.824075549"
Jul 29 02:36:11.808848 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:11.808784    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-29x8f" podStartSLOduration=67.717311616 podStartE2EDuration="1m9.808762002s" totalImagesPullingTime="2.091450386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:11.807753003 +0000 UTC m=+69.842469713" watchObservedRunningTime="2026-07-29 02:36:11.808762002 +0000 UTC m=+69.843478691"
Jul 29 02:36:12.458006 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:12.457954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:12.461303 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:12.461265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:12.772565 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:12.772467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:12.773862 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:12.773840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f7bcd7cf-nm5fw"
Jul 29 02:36:19.802394 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.802350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mb46c" event={"ID":"5bebd31d-8134-4583-8ad5-97814390926a","Type":"ContainerStarted","Data":"124ce625131323e9f91d7ea31b717d3cf90bdcb2548448e1f814a39b9a87f4e5"}
Jul 29 02:36:19.804454 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.804377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx" event={"ID":"164f6f46-c328-4c86-9b9b-8c640b30743e","Type":"ContainerStarted","Data":"6bd95daab0e9e88fc34281caa3fd8243215573806c46f19c31ebbd64c42a92f2"}
Jul 29 02:36:19.804454 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.804429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx" event={"ID":"164f6f46-c328-4c86-9b9b-8c640b30743e","Type":"ContainerStarted","Data":"41ea04d4cc5ffaa037a0a5cdec8575ac01f16c0dd00bb0a57f3caa69c6eb3426"}
Jul 29 02:36:19.806570 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.806146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd" event={"ID":"f497a683-8dce-456e-9940-3a9728fb3c5b","Type":"ContainerStarted","Data":"66c0d0a6c5f835845c3654a9ef76a4c0dd97cb9380c4c031edc378ea9dd10cbf"}
Jul 29 02:36:19.808437 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.808408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfnd" event={"ID":"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9","Type":"ContainerStarted","Data":"d91fc39d2b7808b30a6c60469657fcb5d50ff691cb29cbe8636315d91fd318df"}
Jul 29 02:36:19.810606 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.810572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pjnm" event={"ID":"78da0e9a-4047-4386-b822-31cb5f3b709f","Type":"ContainerStarted","Data":"2598d4f03879fd40d678fe31dbd463e4368772adfcf7eed107b6b2053d78ed49"}
Jul 29 02:36:19.810714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.810621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pjnm" event={"ID":"78da0e9a-4047-4386-b822-31cb5f3b709f","Type":"ContainerStarted","Data":"46480310df15c245c9c044448ab6c0518ee0a4908de22959ce5106b4f988c162"}
Jul 29 02:36:19.810714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.810660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:36:19.812368 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.812336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj" event={"ID":"8130e49d-e855-4419-a90e-b3dc78912598","Type":"ContainerStarted","Data":"0610dec93df85ec793ab1d930e38be9e17efb4ea6d7e0d5a5a35174eabb09694"}
Jul 29 02:36:19.817738 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.817691    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mb46c" podStartSLOduration=67.198742169 podStartE2EDuration="1m17.817676392s" totalImagesPullingTime="10.618934223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:19.81697718 +0000 UTC m=+77.851693871" watchObservedRunningTime="2026-07-29 02:36:19.817676392 +0000 UTC m=+77.852393071"
Jul 29 02:36:19.833028 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.832973    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-46nbd" podStartSLOduration=33.909758746 podStartE2EDuration="41.8329539s" totalImagesPullingTime="7.923195154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:19.83158424 +0000 UTC m=+77.866300935" watchObservedRunningTime="2026-07-29 02:36:19.8329539 +0000 UTC m=+77.867670589"
Jul 29 02:36:19.847120 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.847047    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rk8jx" podStartSLOduration=33.965485043 podStartE2EDuration="41.847027017s" totalImagesPullingTime="7.881541974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:19.846593482 +0000 UTC m=+77.881310171" watchObservedRunningTime="2026-07-29 02:36:19.847027017 +0000 UTC m=+77.881743708"
Jul 29 02:36:19.873318 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.873255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8pjnm" podStartSLOduration=35.70297832 podStartE2EDuration="43.873218345s" totalImagesPullingTime="8.170240025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:19.872112958 +0000 UTC m=+77.906829648" watchObservedRunningTime="2026-07-29 02:36:19.873218345 +0000 UTC m=+77.907935036"
Jul 29 02:36:19.888117 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:19.888056    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5868bc9764-dtgwj" podStartSLOduration=1.9513897930000002 podStartE2EDuration="11.888035615s" totalImagesPullingTime="9.936645822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:19.887299422 +0000 UTC m=+77.922016112" watchObservedRunningTime="2026-07-29 02:36:19.888035615 +0000 UTC m=+77.922752303"
Jul 29 02:36:22.826965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:22.826875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfnd" event={"ID":"2cd022d7-bd48-44a5-ac54-2523a2ef9ba9","Type":"ContainerStarted","Data":"ca89291820221693011de8ec1b0d95db13fdc3a3074892da51008c3f3f9a69f5"}
Jul 29 02:36:22.844638 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:22.844571    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9xfnd" podStartSLOduration=16.851410936 podStartE2EDuration="35.844551364s" totalImagesPullingTime="18.993140428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:22.843709043 +0000 UTC m=+80.878425731" watchObservedRunningTime="2026-07-29 02:36:22.844551364 +0000 UTC m=+80.879268052"
Jul 29 02:36:29.820526 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:29.820390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8pjnm"
Jul 29 02:36:30.751313 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:30.751279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:30.843455 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:30.843399    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:36:40.750529 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:40.750492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-46kkw"
Jul 29 02:36:42.968665 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.968627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kmp92"]
Jul 29 02:36:42.988831 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.988796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:42.991890 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.991860    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 02:36:42.992054 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.991911    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 02:36:42.992054 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.991930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 02:36:42.992054 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.991940    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8zmpg\""
Jul 29 02:36:42.992210 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:42.992078    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 02:36:43.076342 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-sys\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076534 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-textfile\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076534 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076534 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-root\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-metrics-client-ca\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8qh\" (UniqueName: \"kubernetes.io/projected/eb688823-a86b-47ec-9382-4bc4d5a9646b-kube-api-access-qv8qh\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-wtmp\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.076650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.076648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177562 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-sys\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177562 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-textfile\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-sys\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-root\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.177822 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-metrics-client-ca\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-root\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8qh\" (UniqueName: \"kubernetes.io/projected/eb688823-a86b-47ec-9382-4bc4d5a9646b-kube-api-access-qv8qh\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-wtmp\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.177960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178212 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.178047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-textfile\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178212 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.178075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-wtmp\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178212 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:36:43.178079    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 02:36:43.178212 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:36:43.178191    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls podName:eb688823-a86b-47ec-9382-4bc4d5a9646b nodeName:}" failed. No retries permitted until 2026-07-29 02:36:43.678168599 +0000 UTC m=+101.712885278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls") pod "node-exporter-kmp92" (UID: "eb688823-a86b-47ec-9382-4bc4d5a9646b") : secret "node-exporter-tls" not found
Jul 29 02:36:43.178402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.178382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.178437 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.178408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb688823-a86b-47ec-9382-4bc4d5a9646b-metrics-client-ca\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.180283 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.180228    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.194784 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.194753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8qh\" (UniqueName: \"kubernetes.io/projected/eb688823-a86b-47ec-9382-4bc4d5a9646b-kube-api-access-qv8qh\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.681965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.681917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.684440 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.684406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb688823-a86b-47ec-9382-4bc4d5a9646b-node-exporter-tls\") pod \"node-exporter-kmp92\" (UID: \"eb688823-a86b-47ec-9382-4bc4d5a9646b\") " pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.898896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:43.898863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kmp92"
Jul 29 02:36:43.912531 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:36:43.912486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb688823_a86b_47ec_9382_4bc4d5a9646b.slice/crio-e00b46afccaa1f04484387d10d0a3b7f3c3edc78974eb7bb8c3154ecc1484506 WatchSource:0}: Error finding container e00b46afccaa1f04484387d10d0a3b7f3c3edc78974eb7bb8c3154ecc1484506: Status 404 returned error can't find the container with id e00b46afccaa1f04484387d10d0a3b7f3c3edc78974eb7bb8c3154ecc1484506
Jul 29 02:36:44.906296 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:44.906258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmp92" event={"ID":"eb688823-a86b-47ec-9382-4bc4d5a9646b","Type":"ContainerStarted","Data":"e00b46afccaa1f04484387d10d0a3b7f3c3edc78974eb7bb8c3154ecc1484506"}
Jul 29 02:36:45.915146 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:45.915106    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb688823-a86b-47ec-9382-4bc4d5a9646b" containerID="40bf757662affd5aff6f7f05d743863de603d7248a03394be9f9faacc58f1ea4" exitCode=0
Jul 29 02:36:45.915674 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:45.915198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmp92" event={"ID":"eb688823-a86b-47ec-9382-4bc4d5a9646b","Type":"ContainerDied","Data":"40bf757662affd5aff6f7f05d743863de603d7248a03394be9f9faacc58f1ea4"}
Jul 29 02:36:46.920941 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:46.920903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmp92" event={"ID":"eb688823-a86b-47ec-9382-4bc4d5a9646b","Type":"ContainerStarted","Data":"36223442fd317e883a0dc8ab91a9646bb6e5fb48fb4085cdfce2cc07bfcebad1"}
Jul 29 02:36:46.921468 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:46.920967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmp92" event={"ID":"eb688823-a86b-47ec-9382-4bc4d5a9646b","Type":"ContainerStarted","Data":"e3f570c4802dcc5f4dc0833367825e242925c7b4fff002523f930e3c7fae8876"}
Jul 29 02:36:46.947502 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:46.944727    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kmp92" podStartSLOduration=3.512213766 podStartE2EDuration="4.944705532s" totalImagesPullingTime="1.329683563s" totalInitContainerRuntime="102.808203ms" isStatefulPod=true podCreationTimestamp="2026-07-29 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:46.941992509 +0000 UTC m=+104.976709198" watchObservedRunningTime="2026-07-29 02:36:46.944705532 +0000 UTC m=+104.979422222"
Jul 29 02:36:55.879063 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:55.879024    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" podUID="04b2493e-6ce5-48f3-8393-8d17ba162e43" containerName="registry" containerID="cri-o://d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8" gracePeriod=30
Jul 29 02:36:56.159047 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.159018    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:56.290708 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6zbm\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.290896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.290896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.290896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.290896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.290896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.291153 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.290952    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.291153 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.291037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted\") pod \"04b2493e-6ce5-48f3-8393-8d17ba162e43\" (UID: \"04b2493e-6ce5-48f3-8393-8d17ba162e43\") "
Jul 29 02:36:56.291362 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.291335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:36:56.291805 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.291781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:36:56.293856 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.293821    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:36:56.293985 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.293898    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:36:56.293985 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.293885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:36:56.293985 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.293965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm" (OuterVolumeSpecName: "kube-api-access-v6zbm") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "kube-api-access-v6zbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:36:56.294142 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.293989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:36:56.300362 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.300330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "04b2493e-6ce5-48f3-8393-8d17ba162e43" (UID: "04b2493e-6ce5-48f3-8393-8d17ba162e43"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:36:56.392394 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392347    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-image-registry-private-configuration\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392394 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392384    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-bound-sa-token\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392394 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392399    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-tls\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392409    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-registry-certificates\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392421    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04b2493e-6ce5-48f3-8393-8d17ba162e43-trusted-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392432    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04b2493e-6ce5-48f3-8393-8d17ba162e43-ca-trust-extracted\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392442    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6zbm\" (UniqueName: \"kubernetes.io/projected/04b2493e-6ce5-48f3-8393-8d17ba162e43-kube-api-access-v6zbm\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.392636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.392453    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04b2493e-6ce5-48f3-8393-8d17ba162e43-installation-pull-secrets\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:36:56.958918 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.958878    2560 generic.go:356] "Generic (PLEG): container finished" podID="04b2493e-6ce5-48f3-8393-8d17ba162e43" containerID="d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8" exitCode=0
Jul 29 02:36:56.959435 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.958932    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d986665d8-mflgl"
Jul 29 02:36:56.959435 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.958971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" event={"ID":"04b2493e-6ce5-48f3-8393-8d17ba162e43","Type":"ContainerDied","Data":"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"}
Jul 29 02:36:56.959435 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.959035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d986665d8-mflgl" event={"ID":"04b2493e-6ce5-48f3-8393-8d17ba162e43","Type":"ContainerDied","Data":"13c105f8c82d4205dd19b96ac24af2a2229b98b528d65660f071ef7e1145cbea"}
Jul 29 02:36:56.959435 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.959061    2560 scope.go:117] "RemoveContainer" containerID="d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"
Jul 29 02:36:56.960737 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.960712    2560 generic.go:356] "Generic (PLEG): container finished" podID="01daba41-2f6a-4416-a2d5-b5ecea850aa2" containerID="37ff8689abef089fd2fe74c0f3863096c2189cf559cc8b64f88f98e1feaed8e5" exitCode=0
Jul 29 02:36:56.960878 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.960799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-l9tw4" event={"ID":"01daba41-2f6a-4416-a2d5-b5ecea850aa2","Type":"ContainerDied","Data":"37ff8689abef089fd2fe74c0f3863096c2189cf559cc8b64f88f98e1feaed8e5"}
Jul 29 02:36:56.961518 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.961212    2560 scope.go:117] "RemoveContainer" containerID="37ff8689abef089fd2fe74c0f3863096c2189cf559cc8b64f88f98e1feaed8e5"
Jul 29 02:36:56.962548 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.962521    2560 generic.go:356] "Generic (PLEG): container finished" podID="e904d051-def7-468b-85e5-5aa470c9c79b" containerID="c64b37cc9a9a1a5658c8d7318c96e379e7b5862928310bcbbb70659f034d5428" exitCode=0
Jul 29 02:36:56.962636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.962568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s" event={"ID":"e904d051-def7-468b-85e5-5aa470c9c79b","Type":"ContainerDied","Data":"c64b37cc9a9a1a5658c8d7318c96e379e7b5862928310bcbbb70659f034d5428"}
Jul 29 02:36:56.962925 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.962908    2560 scope.go:117] "RemoveContainer" containerID="c64b37cc9a9a1a5658c8d7318c96e379e7b5862928310bcbbb70659f034d5428"
Jul 29 02:36:56.969497 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.969473    2560 scope.go:117] "RemoveContainer" containerID="d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"
Jul 29 02:36:56.969826 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:36:56.969802    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8\": container with ID starting with d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8 not found: ID does not exist" containerID="d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"
Jul 29 02:36:56.969933 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:56.969834    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8"} err="failed to get container status \"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8\": rpc error: code = NotFound desc = could not find container \"d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8\": container with ID starting with d3206ff484540b9f7b5f5385d5308ae1987e033546a9a519e017e95a06ccb9c8 not found: ID does not exist"
Jul 29 02:36:57.014237 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:57.014201    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:36:57.019624 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:57.019594    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d986665d8-mflgl"]
Jul 29 02:36:57.968820 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:57.968777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-l9tw4" event={"ID":"01daba41-2f6a-4416-a2d5-b5ecea850aa2","Type":"ContainerStarted","Data":"e325890e53692d78c2cae9b0c2aa8dfe16249a978c2ebfdddb160744e113034b"}
Jul 29 02:36:57.970597 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:57.970562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z282s" event={"ID":"e904d051-def7-468b-85e5-5aa470c9c79b","Type":"ContainerStarted","Data":"bcc728ec690dabc7d5e0546d375f9e07f29b8ef5d5c53311683d90f16fb4a125"}
Jul 29 02:36:58.409364 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:36:58.409262    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b2493e-6ce5-48f3-8393-8d17ba162e43" path="/var/lib/kubelet/pods/04b2493e-6ce5-48f3-8393-8d17ba162e43/volumes"
Jul 29 02:37:12.029163 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:37:12.029125    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c7976ea-0897-4d88-941a-1daea881c234" containerID="c139b6bcc28461d5ba73794e13c1fd6873596255ed061f245117e26b95ec8746" exitCode=0
Jul 29 02:37:12.029594 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:37:12.029198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96" event={"ID":"3c7976ea-0897-4d88-941a-1daea881c234","Type":"ContainerDied","Data":"c139b6bcc28461d5ba73794e13c1fd6873596255ed061f245117e26b95ec8746"}
Jul 29 02:37:12.029594 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:37:12.029515    2560 scope.go:117] "RemoveContainer" containerID="c139b6bcc28461d5ba73794e13c1fd6873596255ed061f245117e26b95ec8746"
Jul 29 02:37:13.035831 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:37:13.035794    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jfh96" event={"ID":"3c7976ea-0897-4d88-941a-1daea881c234","Type":"ContainerStarted","Data":"32b0724c3c74cd2307880bede4d0d8a1777fe56a962727938fdd6f36383d3f52"}
Jul 29 02:38:07.230642 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.230559    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"]
Jul 29 02:38:07.231081 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.230898    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b2493e-6ce5-48f3-8393-8d17ba162e43" containerName="registry"
Jul 29 02:38:07.231081 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.230913    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b2493e-6ce5-48f3-8393-8d17ba162e43" containerName="registry"
Jul 29 02:38:07.231081 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.231000    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b2493e-6ce5-48f3-8393-8d17ba162e43" containerName="registry"
Jul 29 02:38:07.233405 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.233383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.236271 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.236183    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 02:38:07.236426 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.236379    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 02:38:07.236648 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.236523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mfjmg\""
Jul 29 02:38:07.236739 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.236675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 02:38:07.239856 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.237003    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 02:38:07.239856 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.237227    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 02:38:07.244989 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.244959    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 02:38:07.246035 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.246010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"]
Jul 29 02:38:07.356047 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356047 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-serving-certs-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-metrics-client-ca\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zfd7\" (UniqueName: \"kubernetes.io/projected/d82bb253-6b0b-4bbb-9122-9089751b4646-kube-api-access-6zfd7\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-federate-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.356315 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.356288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfd7\" (UniqueName: \"kubernetes.io/projected/d82bb253-6b0b-4bbb-9122-9089751b4646-kube-api-access-6zfd7\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457053 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-federate-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-serving-certs-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-metrics-client-ca\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.457348 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.457298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.458077 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.458048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-serving-certs-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.458177 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.458132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.458239 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.458220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82bb253-6b0b-4bbb-9122-9089751b4646-metrics-client-ca\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.459787 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.459763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.459896 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.459874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.459943 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.459931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-federate-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.460006 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.459983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d82bb253-6b0b-4bbb-9122-9089751b4646-telemeter-client-tls\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.465314 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.465223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfd7\" (UniqueName: \"kubernetes.io/projected/d82bb253-6b0b-4bbb-9122-9089751b4646-kube-api-access-6zfd7\") pod \"telemeter-client-7d9694bccf-zc8xv\" (UID: \"d82bb253-6b0b-4bbb-9122-9089751b4646\") " pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.548024 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.547936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"
Jul 29 02:38:07.684582 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:07.684481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d9694bccf-zc8xv"]
Jul 29 02:38:07.686629 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:38:07.686601    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82bb253_6b0b_4bbb_9122_9089751b4646.slice/crio-95ca78c8d15f972f8b777d8518e5fb750e90b647a017063d488de0f88eb0bd89 WatchSource:0}: Error finding container 95ca78c8d15f972f8b777d8518e5fb750e90b647a017063d488de0f88eb0bd89: Status 404 returned error can't find the container with id 95ca78c8d15f972f8b777d8518e5fb750e90b647a017063d488de0f88eb0bd89
Jul 29 02:38:08.247645 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:08.247608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv" event={"ID":"d82bb253-6b0b-4bbb-9122-9089751b4646","Type":"ContainerStarted","Data":"95ca78c8d15f972f8b777d8518e5fb750e90b647a017063d488de0f88eb0bd89"}
Jul 29 02:38:10.257691 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:10.257657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv" event={"ID":"d82bb253-6b0b-4bbb-9122-9089751b4646","Type":"ContainerStarted","Data":"5f67e81264f2ab3a702a7f013b46bd6a960d026d79aeda98d1ccdd9388831bbe"}
Jul 29 02:38:11.263321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:11.263282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv" event={"ID":"d82bb253-6b0b-4bbb-9122-9089751b4646","Type":"ContainerStarted","Data":"61be6dcffcf2be8550d01806087db0176291f2a7afde6af17c02b2915b5f3f2f"}
Jul 29 02:38:11.263701 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:11.263349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv" event={"ID":"d82bb253-6b0b-4bbb-9122-9089751b4646","Type":"ContainerStarted","Data":"419e0e9a653d867b9375347fbeb6ab144da8b464a6ff4dec1837fbe3db10b36d"}
Jul 29 02:38:11.282916 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:38:11.282848    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d9694bccf-zc8xv" podStartSLOduration=1.426654661 podStartE2EDuration="4.282831507s" totalImagesPullingTime="2.856176846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:38:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:38:11.282472806 +0000 UTC m=+189.317189496" watchObservedRunningTime="2026-07-29 02:38:11.282831507 +0000 UTC m=+189.317548197"
Jul 29 02:39:08.205433 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.205389    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"]
Jul 29 02:39:08.208825 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.208796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.211559 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.211534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cpr26\""
Jul 29 02:39:08.211698 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.211534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 02:39:08.211698 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.211536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 02:39:08.219146 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.219112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"]
Jul 29 02:39:08.339714 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.339672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.339924 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.339721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.339924 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.339782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rklv\" (UniqueName: \"kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.440538 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.440495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.440538 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.440536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rklv\" (UniqueName: \"kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.440744 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.440593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.440963 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.440948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.441003 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.440946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.448721 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.448679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rklv\" (UniqueName: \"kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.518575 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.518467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:08.654203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:08.654175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"]
Jul 29 02:39:08.656578 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:39:08.656545    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a5659f_7640_4d57_9c16_3fefb1c4f562.slice/crio-ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f WatchSource:0}: Error finding container ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f: Status 404 returned error can't find the container with id ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f
Jul 29 02:39:09.478097 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:09.478053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2" event={"ID":"38a5659f-7640-4d57-9c16-3fefb1c4f562","Type":"ContainerStarted","Data":"ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f"}
Jul 29 02:39:16.506625 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:16.506586    2560 generic.go:356] "Generic (PLEG): container finished" podID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerID="923b2bab36c6000586544fe1033d7d929c2fb730dbc882585d4dc92cb6f290a3" exitCode=0
Jul 29 02:39:16.507046 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:16.506673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2" event={"ID":"38a5659f-7640-4d57-9c16-3fefb1c4f562","Type":"ContainerDied","Data":"923b2bab36c6000586544fe1033d7d929c2fb730dbc882585d4dc92cb6f290a3"}
Jul 29 02:39:19.519993 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:19.519950    2560 generic.go:356] "Generic (PLEG): container finished" podID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerID="06fc78e11e0701fbb23e541adaa635d0e60b6f752d5e1ddf0c5068266f016e5f" exitCode=0
Jul 29 02:39:19.520398 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:19.520011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2" event={"ID":"38a5659f-7640-4d57-9c16-3fefb1c4f562","Type":"ContainerDied","Data":"06fc78e11e0701fbb23e541adaa635d0e60b6f752d5e1ddf0c5068266f016e5f"}
Jul 29 02:39:26.554268 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:26.554200    2560 generic.go:356] "Generic (PLEG): container finished" podID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerID="079b147a74fdfb6731a47c843c81241caae52e61f8db71460ef981abd419b588" exitCode=0
Jul 29 02:39:26.554684 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:26.554298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2" event={"ID":"38a5659f-7640-4d57-9c16-3fefb1c4f562","Type":"ContainerDied","Data":"079b147a74fdfb6731a47c843c81241caae52e61f8db71460ef981abd419b588"}
Jul 29 02:39:27.701612 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.701584    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:27.813768 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.813660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util\") pod \"38a5659f-7640-4d57-9c16-3fefb1c4f562\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") "
Jul 29 02:39:27.813932 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.813779    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rklv\" (UniqueName: \"kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv\") pod \"38a5659f-7640-4d57-9c16-3fefb1c4f562\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") "
Jul 29 02:39:27.813932 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.813899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle\") pod \"38a5659f-7640-4d57-9c16-3fefb1c4f562\" (UID: \"38a5659f-7640-4d57-9c16-3fefb1c4f562\") "
Jul 29 02:39:27.814527 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.814497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle" (OuterVolumeSpecName: "bundle") pod "38a5659f-7640-4d57-9c16-3fefb1c4f562" (UID: "38a5659f-7640-4d57-9c16-3fefb1c4f562"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:39:27.816055 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.816028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv" (OuterVolumeSpecName: "kube-api-access-5rklv") pod "38a5659f-7640-4d57-9c16-3fefb1c4f562" (UID: "38a5659f-7640-4d57-9c16-3fefb1c4f562"). InnerVolumeSpecName "kube-api-access-5rklv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:39:27.817994 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.817965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util" (OuterVolumeSpecName: "util") pod "38a5659f-7640-4d57-9c16-3fefb1c4f562" (UID: "38a5659f-7640-4d57-9c16-3fefb1c4f562"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:39:27.915141 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.915095    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:27.915141 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.915129    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a5659f-7640-4d57-9c16-3fefb1c4f562-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:27.915141 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:27.915143    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rklv\" (UniqueName: \"kubernetes.io/projected/38a5659f-7640-4d57-9c16-3fefb1c4f562-kube-api-access-5rklv\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:28.566112 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:28.566078    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2"
Jul 29 02:39:28.566112 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:28.566090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408wzc2" event={"ID":"38a5659f-7640-4d57-9c16-3fefb1c4f562","Type":"ContainerDied","Data":"ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f"}
Jul 29 02:39:28.566344 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:28.566140    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea60905820d0d89d1aaf9ebd695373e165690f2f0e842249fd36f87f97f3fe9f"
Jul 29 02:39:36.097875 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.097839    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"]
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098117    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="util"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098128    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="util"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098146    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="pull"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098152    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="pull"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098162    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="extract"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098168    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="extract"
Jul 29 02:39:36.098309 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.098210    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a5659f-7640-4d57-9c16-3fefb1c4f562" containerName="extract"
Jul 29 02:39:36.101556 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.101535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.104279 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.104241    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:39:36.104392 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.104369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 02:39:36.104437 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.104423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ktqj6\""
Jul 29 02:39:36.112392 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.112361    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"]
Jul 29 02:39:36.181231 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.181186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd0bed52-7465-439f-81c5-5216e8027e47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.181441 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.181289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9n7\" (UniqueName: \"kubernetes.io/projected/fd0bed52-7465-439f-81c5-5216e8027e47-kube-api-access-5x9n7\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.281638 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.281601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9n7\" (UniqueName: \"kubernetes.io/projected/fd0bed52-7465-439f-81c5-5216e8027e47-kube-api-access-5x9n7\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.281819 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.281659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd0bed52-7465-439f-81c5-5216e8027e47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.282024 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.282008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd0bed52-7465-439f-81c5-5216e8027e47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.290558 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.290524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9n7\" (UniqueName: \"kubernetes.io/projected/fd0bed52-7465-439f-81c5-5216e8027e47-kube-api-access-5x9n7\") pod \"cert-manager-operator-controller-manager-55c444bf86-wnf8j\" (UID: \"fd0bed52-7465-439f-81c5-5216e8027e47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.411856 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.411761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"
Jul 29 02:39:36.564144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.564040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j"]
Jul 29 02:39:36.567737 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:39:36.567709    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0bed52_7465_439f_81c5_5216e8027e47.slice/crio-c013114dfbcd8eb6b8b3286fee31413b8c693b5c53d15b81b141b09d4e0c9b6b WatchSource:0}: Error finding container c013114dfbcd8eb6b8b3286fee31413b8c693b5c53d15b81b141b09d4e0c9b6b: Status 404 returned error can't find the container with id c013114dfbcd8eb6b8b3286fee31413b8c693b5c53d15b81b141b09d4e0c9b6b
Jul 29 02:39:36.597801 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:36.597764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j" event={"ID":"fd0bed52-7465-439f-81c5-5216e8027e47","Type":"ContainerStarted","Data":"c013114dfbcd8eb6b8b3286fee31413b8c693b5c53d15b81b141b09d4e0c9b6b"}
Jul 29 02:39:38.607903 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:38.607809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j" event={"ID":"fd0bed52-7465-439f-81c5-5216e8027e47","Type":"ContainerStarted","Data":"b30b6d6c3b242a862b7f78ee3d057da38f664a860b41da05db1fa34823001fa1"}
Jul 29 02:39:38.629313 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:38.629233    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wnf8j" podStartSLOduration=1.015176263 podStartE2EDuration="2.629215281s" totalImagesPullingTime="1.614039018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:39:38.626449078 +0000 UTC m=+276.661165757" watchObservedRunningTime="2026-07-29 02:39:38.629215281 +0000 UTC m=+276.663931969"
Jul 29 02:39:39.436881 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.436834    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n75pd"]
Jul 29 02:39:39.439182 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.439162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.441852 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.441822    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 02:39:39.443018 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.442996    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 02:39:39.443018 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.443009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ksvct\""
Jul 29 02:39:39.448993 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.448962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n75pd"]
Jul 29 02:39:39.504632 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.504582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hgkn\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-kube-api-access-7hgkn\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.505018 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.504982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.605741 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.605696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.605912 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.605761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hgkn\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-kube-api-access-7hgkn\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.614326 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.614293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.614669 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.614469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hgkn\" (UniqueName: \"kubernetes.io/projected/d7e3c25b-845d-47da-be90-766a25f1acf7-kube-api-access-7hgkn\") pod \"cert-manager-webhook-6486ffd997-n75pd\" (UID: \"d7e3c25b-845d-47da-be90-766a25f1acf7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.748799 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.748699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:39.852318 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.852277    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"]
Jul 29 02:39:39.854871 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.854835    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:39.857922 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.857891    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 02:39:39.858100 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.857930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cpr26\""
Jul 29 02:39:39.858100 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.857891    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 02:39:39.867072 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.867034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"]
Jul 29 02:39:39.887557 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.887530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n75pd"]
Jul 29 02:39:39.890167 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:39:39.890134    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7e3c25b_845d_47da_be90_766a25f1acf7.slice/crio-eccf28f735bbcfdb2f41fe533c8f3a25e8cce31d91c57f830beca90eb044623a WatchSource:0}: Error finding container eccf28f735bbcfdb2f41fe533c8f3a25e8cce31d91c57f830beca90eb044623a: Status 404 returned error can't find the container with id eccf28f735bbcfdb2f41fe533c8f3a25e8cce31d91c57f830beca90eb044623a
Jul 29 02:39:39.908232 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.908192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:39.908442 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.908283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:39.908442 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:39.908325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h58c\" (UniqueName: \"kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.009034 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.008936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.009199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.009078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h58c\" (UniqueName: \"kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.009199 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.009125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.009463 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.009442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.009507 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.009461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.018620 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.018581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h58c\" (UniqueName: \"kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.165782 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.165732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:40.300724 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.300695    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"]
Jul 29 02:39:40.302399 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:39:40.302372    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e529a8_4b60_4630_9112_1b18de2083d8.slice/crio-c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe WatchSource:0}: Error finding container c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe: Status 404 returned error can't find the container with id c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe
Jul 29 02:39:40.625151 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.625057    2560 generic.go:356] "Generic (PLEG): container finished" podID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerID="a2e5ca411ee7a804f6a9afe72c41c12bd34073e2dc547f9e28496bd786edd3be" exitCode=0
Jul 29 02:39:40.625151 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.625127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerDied","Data":"a2e5ca411ee7a804f6a9afe72c41c12bd34073e2dc547f9e28496bd786edd3be"}
Jul 29 02:39:40.625656 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.625261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerStarted","Data":"c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe"}
Jul 29 02:39:40.626615 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:40.626588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd" event={"ID":"d7e3c25b-845d-47da-be90-766a25f1acf7","Type":"ContainerStarted","Data":"eccf28f735bbcfdb2f41fe533c8f3a25e8cce31d91c57f830beca90eb044623a"}
Jul 29 02:39:42.638471 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:42.638430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerStarted","Data":"e5cec32abf29dbf3c4299ba61d2b9898e6ce3828ba8e88c724bc100cc87b5a76"}
Jul 29 02:39:43.647788 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:43.647743    2560 generic.go:356] "Generic (PLEG): container finished" podID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerID="e5cec32abf29dbf3c4299ba61d2b9898e6ce3828ba8e88c724bc100cc87b5a76" exitCode=0
Jul 29 02:39:43.648210 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:43.647842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerDied","Data":"e5cec32abf29dbf3c4299ba61d2b9898e6ce3828ba8e88c724bc100cc87b5a76"}
Jul 29 02:39:44.655800 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:44.655760    2560 generic.go:356] "Generic (PLEG): container finished" podID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerID="c589b73f9422f51dfef15aaee8ee26935c493506d88e53035a320697330ce281" exitCode=0
Jul 29 02:39:44.656235 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:44.655841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerDied","Data":"c589b73f9422f51dfef15aaee8ee26935c493506d88e53035a320697330ce281"}
Jul 29 02:39:45.661538 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.661500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd" event={"ID":"d7e3c25b-845d-47da-be90-766a25f1acf7","Type":"ContainerStarted","Data":"ce444d2fcc8b5797f095add406506f05122a3c456ca9f562134b0a2c7d9072c2"}
Jul 29 02:39:45.661971 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.661562    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:39:45.677949 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.677894    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd" podStartSLOduration=1.833572099 podStartE2EDuration="6.677875153s" totalImagesPullingTime="4.844303054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:39:45.676831185 +0000 UTC m=+283.711547873" watchObservedRunningTime="2026-07-29 02:39:45.677875153 +0000 UTC m=+283.712591842"
Jul 29 02:39:45.793409 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.793381    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:45.853408 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.853368    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle\") pod \"c5e529a8-4b60-4630-9112-1b18de2083d8\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") "
Jul 29 02:39:45.853613 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.853439    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h58c\" (UniqueName: \"kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c\") pod \"c5e529a8-4b60-4630-9112-1b18de2083d8\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") "
Jul 29 02:39:45.853613 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.853511    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util\") pod \"c5e529a8-4b60-4630-9112-1b18de2083d8\" (UID: \"c5e529a8-4b60-4630-9112-1b18de2083d8\") "
Jul 29 02:39:45.853870 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.853845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle" (OuterVolumeSpecName: "bundle") pod "c5e529a8-4b60-4630-9112-1b18de2083d8" (UID: "c5e529a8-4b60-4630-9112-1b18de2083d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:39:45.855548 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.855519    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c" (OuterVolumeSpecName: "kube-api-access-4h58c") pod "c5e529a8-4b60-4630-9112-1b18de2083d8" (UID: "c5e529a8-4b60-4630-9112-1b18de2083d8"). InnerVolumeSpecName "kube-api-access-4h58c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:39:45.858233 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.858205    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util" (OuterVolumeSpecName: "util") pod "c5e529a8-4b60-4630-9112-1b18de2083d8" (UID: "c5e529a8-4b60-4630-9112-1b18de2083d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:39:45.955322 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.955281    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:45.955322 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.955334    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e529a8-4b60-4630-9112-1b18de2083d8-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:45.955535 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:45.955345    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h58c\" (UniqueName: \"kubernetes.io/projected/c5e529a8-4b60-4630-9112-1b18de2083d8-kube-api-access-4h58c\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:39:46.667829 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:46.667751    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7"
Jul 29 02:39:46.667829 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:46.667778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwdd7" event={"ID":"c5e529a8-4b60-4630-9112-1b18de2083d8","Type":"ContainerDied","Data":"c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe"}
Jul 29 02:39:46.668365 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:46.667831    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0d1fba09d28498a304fc079e20b5d340212d62a5271cc4cf6b60d05b231bdbe"
Jul 29 02:39:51.670098 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:39:51.670066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n75pd"
Jul 29 02:40:02.318935 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:02.318902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:40:02.320034 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:02.320011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:40:02.334700 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:02.334670    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 02:40:04.470697 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.470660    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"]
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.470978    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="extract"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.470990    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="extract"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.471005    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="util"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.471013    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="util"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.471025    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="pull"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.471030    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="pull"
Jul 29 02:40:04.472144 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.471094    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e529a8-4b60-4630-9112-1b18de2083d8" containerName="extract"
Jul 29 02:40:04.472957 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.472941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.475357 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.475330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 02:40:04.475357 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.475348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cpr26\""
Jul 29 02:40:04.476601 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.476579    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 02:40:04.481471 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.481450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"]
Jul 29 02:40:04.595445 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.595403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.595639 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.595458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzcn7\" (UniqueName: \"kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.595639 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.595534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.696648 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.696613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.696851 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.696666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzcn7\" (UniqueName: \"kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.696851 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.696716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.697012 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.696990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.697087 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.697048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.704610 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.704581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzcn7\" (UniqueName: \"kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.784069 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.783969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:04.916487 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:04.916448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"]
Jul 29 02:40:04.919614 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:40:04.919585    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c7b365_e66d_4a61_9358_6eaf8a18bcaa.slice/crio-e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43 WatchSource:0}: Error finding container e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43: Status 404 returned error can't find the container with id e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43
Jul 29 02:40:05.753949 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:05.753911    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerID="f889f7d9e2d29ceb23dff91fce453a498a1e0141895058b5524221d762be7dfe" exitCode=0
Jul 29 02:40:05.754453 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:05.753977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg" event={"ID":"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa","Type":"ContainerDied","Data":"f889f7d9e2d29ceb23dff91fce453a498a1e0141895058b5524221d762be7dfe"}
Jul 29 02:40:05.754453 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:05.754030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg" event={"ID":"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa","Type":"ContainerStarted","Data":"e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43"}
Jul 29 02:40:05.754662 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:05.754641    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:40:06.759990 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:06.759947    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerID="d19df30f2436d1b27b0ea633c5abe8ccf83b78e255bcbbf9a3ed2f66f9561300" exitCode=0
Jul 29 02:40:06.760402 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:06.760033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg" event={"ID":"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa","Type":"ContainerDied","Data":"d19df30f2436d1b27b0ea633c5abe8ccf83b78e255bcbbf9a3ed2f66f9561300"}
Jul 29 02:40:07.765734 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:07.765701    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerID="20932725aba2304a360f884da57b818c8b7856a9dc5020b6796fd83b7cbf5d91" exitCode=0
Jul 29 02:40:07.766106 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:07.765795    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg" event={"ID":"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa","Type":"ContainerDied","Data":"20932725aba2304a360f884da57b818c8b7856a9dc5020b6796fd83b7cbf5d91"}
Jul 29 02:40:08.896620 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.896592    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:08.932865 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.932817    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzcn7\" (UniqueName: \"kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7\") pod \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") "
Jul 29 02:40:08.933078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.932891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle\") pod \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") "
Jul 29 02:40:08.933078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.932932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util\") pod \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\" (UID: \"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa\") "
Jul 29 02:40:08.933689 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.933652    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle" (OuterVolumeSpecName: "bundle") pod "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" (UID: "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:40:08.935153 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.935122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7" (OuterVolumeSpecName: "kube-api-access-fzcn7") pod "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" (UID: "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa"). InnerVolumeSpecName "kube-api-access-fzcn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:40:08.938428 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:08.938380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util" (OuterVolumeSpecName: "util") pod "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" (UID: "f8c7b365-e66d-4a61-9358-6eaf8a18bcaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:40:09.033544 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.033454    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzcn7\" (UniqueName: \"kubernetes.io/projected/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-kube-api-access-fzcn7\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:40:09.033544 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.033484    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:40:09.033544 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.033493    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c7b365-e66d-4a61-9358-6eaf8a18bcaa-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:40:09.776444 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.776408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg" event={"ID":"f8c7b365-e66d-4a61-9358-6eaf8a18bcaa","Type":"ContainerDied","Data":"e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43"}
Jul 29 02:40:09.776444 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.776434    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjt5xg"
Jul 29 02:40:09.776656 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:09.776457    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e37bc6f07ad352c2b559ae8aa7c3b993b5fceff18a3eadb756c002d6a3814d43"
Jul 29 02:40:17.177114 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177076    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"]
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177408    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="pull"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177423    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="pull"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177436    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="extract"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177442    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="extract"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177456    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="util"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177462    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="util"
Jul 29 02:40:17.177551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.177510    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c7b365-e66d-4a61-9358-6eaf8a18bcaa" containerName="extract"
Jul 29 02:40:17.182057 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.182032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.185435 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.185410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 02:40:17.186484 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.186465    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wmb4h\""
Jul 29 02:40:17.186706 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.186688    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 02:40:17.187232 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.187217    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 02:40:17.188723 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.188609    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 02:40:17.222787 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.222742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"]
Jul 29 02:40:17.304761 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.304724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.304928 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.304770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.304928 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.304799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ftf9\" (UniqueName: \"kubernetes.io/projected/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-kube-api-access-4ftf9\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.304928 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.304899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.305022 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.304928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.405972 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.405925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.406301 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.405984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ftf9\" (UniqueName: \"kubernetes.io/projected/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-kube-api-access-4ftf9\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.406301 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.406046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.406301 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.406069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.406301 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.406194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.406525 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.406362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.408332 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.408300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.408551 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.408530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.408614 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.408547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.414413 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.414385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ftf9\" (UniqueName: \"kubernetes.io/projected/6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86-kube-api-access-4ftf9\") pod \"opendatahub-operator-controller-manager-5dbd45849d-9m9lt\" (UID: \"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.492293 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.492162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:17.635040 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.635013    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"]
Jul 29 02:40:17.637326 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:40:17.637298    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6837fe5f_4f10_41df_b9d5_6ebbaf0a3c86.slice/crio-d6ecc4591edd51fa6b49be37dbf042178fc1754612c9c938342566a435bd8916 WatchSource:0}: Error finding container d6ecc4591edd51fa6b49be37dbf042178fc1754612c9c938342566a435bd8916: Status 404 returned error can't find the container with id d6ecc4591edd51fa6b49be37dbf042178fc1754612c9c938342566a435bd8916
Jul 29 02:40:17.811667 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:17.811582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt" event={"ID":"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86","Type":"ContainerStarted","Data":"d6ecc4591edd51fa6b49be37dbf042178fc1754612c9c938342566a435bd8916"}
Jul 29 02:40:20.829393 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:20.829345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt" event={"ID":"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86","Type":"ContainerStarted","Data":"7fc1229155de17a2bc2c5e3dff4454702ded679b851ef17bd314a09a4c0a9d13"}
Jul 29 02:40:21.835606 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:21.835567    2560 generic.go:356] "Generic (PLEG): container finished" podID="6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86" containerID="7fc1229155de17a2bc2c5e3dff4454702ded679b851ef17bd314a09a4c0a9d13" exitCode=0
Jul 29 02:40:21.835991 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:21.835648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt" event={"ID":"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86","Type":"ContainerDied","Data":"7fc1229155de17a2bc2c5e3dff4454702ded679b851ef17bd314a09a4c0a9d13"}
Jul 29 02:40:22.842044 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:22.842004    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt" event={"ID":"6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86","Type":"ContainerStarted","Data":"23ab87412c0a13fd1bdea40899e33e8968b3bf993e8935781ea260aa5740b081"}
Jul 29 02:40:22.842458 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:22.842082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:22.863521 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:22.863457    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt" podStartSLOduration=1.441572646 podStartE2EDuration="5.863433959s" totalImagesPullingTime="3.33774019s" totalInitContainerRuntime="1.084121123s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:22.861760355 +0000 UTC m=+320.896477044" watchObservedRunningTime="2026-07-29 02:40:22.863433959 +0000 UTC m=+320.898150648"
Jul 29 02:40:33.848916 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:33.848884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-9m9lt"
Jul 29 02:40:36.184057 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.184026    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"]
Jul 29 02:40:36.191520 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.191491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.194262 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.194225    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 02:40:36.195547 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.195525    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 02:40:36.195688 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.195569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 02:40:36.195688 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.195569    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 02:40:36.195688 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.195571    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:40:36.195853 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.195688    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lkf7c\""
Jul 29 02:40:36.198625 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.198604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"]
Jul 29 02:40:36.375353 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.375307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7210337-a63b-4b1b-9868-a7cb07ff4d29-manager-config\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.375536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.375373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qz4r\" (UniqueName: \"kubernetes.io/projected/a7210337-a63b-4b1b-9868-a7cb07ff4d29-kube-api-access-4qz4r\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.375536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.375405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-metrics-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.375536 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.375432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.476964 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.476867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7210337-a63b-4b1b-9868-a7cb07ff4d29-manager-config\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.476964 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.476924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qz4r\" (UniqueName: \"kubernetes.io/projected/a7210337-a63b-4b1b-9868-a7cb07ff4d29-kube-api-access-4qz4r\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.477206 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.476988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-metrics-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.477206 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.477024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.477618 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.477576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7210337-a63b-4b1b-9868-a7cb07ff4d29-manager-config\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.479633 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.479611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.479744 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.479631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7210337-a63b-4b1b-9868-a7cb07ff4d29-metrics-cert\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.494875 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.494838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qz4r\" (UniqueName: \"kubernetes.io/projected/a7210337-a63b-4b1b-9868-a7cb07ff4d29-kube-api-access-4qz4r\") pod \"lws-controller-manager-64f48568bd-92jx4\" (UID: \"a7210337-a63b-4b1b-9868-a7cb07ff4d29\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.502558 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.502516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:36.680218 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.680192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"]
Jul 29 02:40:36.682296 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:40:36.682263    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7210337_a63b_4b1b_9868_a7cb07ff4d29.slice/crio-e0cb3fdb75d287943e2c157e4f6aba1437976c4aeccd737f23af19ab449fe4ff WatchSource:0}: Error finding container e0cb3fdb75d287943e2c157e4f6aba1437976c4aeccd737f23af19ab449fe4ff: Status 404 returned error can't find the container with id e0cb3fdb75d287943e2c157e4f6aba1437976c4aeccd737f23af19ab449fe4ff
Jul 29 02:40:36.903387 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:36.903293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4" event={"ID":"a7210337-a63b-4b1b-9868-a7cb07ff4d29","Type":"ContainerStarted","Data":"e0cb3fdb75d287943e2c157e4f6aba1437976c4aeccd737f23af19ab449fe4ff"}
Jul 29 02:40:38.914451 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:38.914350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4" event={"ID":"a7210337-a63b-4b1b-9868-a7cb07ff4d29","Type":"ContainerStarted","Data":"fd58863a73308ebffc6b06aaece4e2f2611269ec70acd7c29d98fac259ce15c4"}
Jul 29 02:40:38.914836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:38.914468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:38.930979 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:38.930922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4" podStartSLOduration=1.109287898 podStartE2EDuration="2.930905346s" totalImagesPullingTime="1.821617448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:38.929578745 +0000 UTC m=+336.964295443" watchObservedRunningTime="2026-07-29 02:40:38.930905346 +0000 UTC m=+336.965622034"
Jul 29 02:40:44.604746 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.604705    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"]
Jul 29 02:40:44.609586 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.609556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.612820 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.612786    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 02:40:44.612820 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.612807    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 02:40:44.613235 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.613204    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 02:40:44.613491 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.613473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dv2wr\""
Jul 29 02:40:44.613588 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.613569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 02:40:44.632210 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.632165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"]
Jul 29 02:40:44.646624 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646782 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ed7887-aa12-4918-8999-b90d019d710a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646782 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646782 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjxx9\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-kube-api-access-pjxx9\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646884 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646884 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.646884 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.646875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.747817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.747779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748026 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.747829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748026 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.747855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ed7887-aa12-4918-8999-b90d019d710a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748026 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.747874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748026 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.747896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjxx9\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-kube-api-access-pjxx9\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748276 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.748047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748276 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.748089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.748727 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.748703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.750314 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.750293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.750499 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.750469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.750627 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.750611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ed7887-aa12-4918-8999-b90d019d710a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.750668 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.750625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ed7887-aa12-4918-8999-b90d019d710a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.755814 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.755782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.755956 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.755935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjxx9\" (UniqueName: \"kubernetes.io/projected/51ed7887-aa12-4918-8999-b90d019d710a-kube-api-access-pjxx9\") pod \"istiod-openshift-gateway-5677ccb49b-c27v8\" (UID: \"51ed7887-aa12-4918-8999-b90d019d710a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:44.919858 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:44.919760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:45.077439 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:45.077413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"]
Jul 29 02:40:45.079237 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:40:45.079203    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ed7887_aa12_4918_8999_b90d019d710a.slice/crio-008b9037a431d6921432a8f6fb63d8279cdd8a5677b9e6a6392ec8c668b44852 WatchSource:0}: Error finding container 008b9037a431d6921432a8f6fb63d8279cdd8a5677b9e6a6392ec8c668b44852: Status 404 returned error can't find the container with id 008b9037a431d6921432a8f6fb63d8279cdd8a5677b9e6a6392ec8c668b44852
Jul 29 02:40:45.950240 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:45.950200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8" event={"ID":"51ed7887-aa12-4918-8999-b90d019d710a","Type":"ContainerStarted","Data":"008b9037a431d6921432a8f6fb63d8279cdd8a5677b9e6a6392ec8c668b44852"}
Jul 29 02:40:47.651485 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:47.651439    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 02:40:47.651737 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:47.651511    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 02:40:47.962183 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:47.962150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8" event={"ID":"51ed7887-aa12-4918-8999-b90d019d710a","Type":"ContainerStarted","Data":"7be86b0605ac33b864da0414b8cc07e4d272082d70a0a968123c4ec34016fdc6"}
Jul 29 02:40:47.962414 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:47.962364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:40:48.969276 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:48.969227    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-c27v8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 02:40:48.969659 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:48.969298    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8" podUID="51ed7887-aa12-4918-8999-b90d019d710a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 02:40:49.922615 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:49.922587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-92jx4"
Jul 29 02:40:49.939669 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:49.939604    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8" podStartSLOduration=3.369658349 podStartE2EDuration="5.939589234s" totalImagesPullingTime="2.569930885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:47.984278287 +0000 UTC m=+346.018994976" watchObservedRunningTime="2026-07-29 02:40:49.939589234 +0000 UTC m=+347.974305925"
Jul 29 02:40:51.968884 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:40:51.968850    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c27v8"
Jul 29 02:41:53.287081 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.287040    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"]
Jul 29 02:41:53.290607 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.290585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.293329 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.293304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pj6th\""
Jul 29 02:41:53.293488 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.293404    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 02:41:53.294445 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.294425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 02:41:53.298640 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.298610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"]
Jul 29 02:41:53.343202 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.343161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqst\" (UniqueName: \"kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.343202 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.343209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.343458 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.343361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.444725 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.444676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.444725 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.444725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqst\" (UniqueName: \"kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.444989 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.444750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.445107 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.445080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.445107 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.445102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.453056 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.453023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqst\" (UniqueName: \"kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.600895 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.600806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:53.739393 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:53.739329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"]
Jul 29 02:41:53.741726 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:41:53.741698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf746c68e_ec57_43b5_aa71_b2976e6ba094.slice/crio-6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c WatchSource:0}: Error finding container 6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c: Status 404 returned error can't find the container with id 6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c
Jul 29 02:41:54.087873 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.084931    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"]
Jul 29 02:41:54.090078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.090043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.094671 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.094639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"]
Jul 29 02:41:54.151486 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.151395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.151486 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.151436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69z9c\" (UniqueName: \"kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.151705 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.151581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.252795 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.252754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.252795 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.252799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69z9c\" (UniqueName: \"kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.253007 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.252865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.253191 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.253167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.253275 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.253227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.261418 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.261382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69z9c\" (UniqueName: \"kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.267359 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.267323    2560 generic.go:356] "Generic (PLEG): container finished" podID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerID="e68cd6c1462167caa7c7de5fb405efb09823a6e2e61dfb84304b110e6aa17518" exitCode=0
Jul 29 02:41:54.267541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.267407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l" event={"ID":"f746c68e-ec57-43b5-aa71-b2976e6ba094","Type":"ContainerDied","Data":"e68cd6c1462167caa7c7de5fb405efb09823a6e2e61dfb84304b110e6aa17518"}
Jul 29 02:41:54.267541 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.267456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l" event={"ID":"f746c68e-ec57-43b5-aa71-b2976e6ba094","Type":"ContainerStarted","Data":"6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c"}
Jul 29 02:41:54.401217 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.401185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:54.486510 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.486478    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"]
Jul 29 02:41:54.490264 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.490218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.499807 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.499767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"]
Jul 29 02:41:54.546281 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.546225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"]
Jul 29 02:41:54.548315 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:41:54.548290    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284c354c_3de1_4142_b8b8_251a561fb916.slice/crio-e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e WatchSource:0}: Error finding container e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e: Status 404 returned error can't find the container with id e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e
Jul 29 02:41:54.555594 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.555566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.555710 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.555648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.555768 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.555714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dgl6\" (UniqueName: \"kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.656737 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.656650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dgl6\" (UniqueName: \"kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.656737 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.656732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.656946 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.656839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.657147 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.657125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.657268 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.657223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.665139 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.665113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dgl6\" (UniqueName: \"kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.803335 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.803297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:54.885430 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.885388    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"]
Jul 29 02:41:54.889351 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.888998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:54.897739 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.897660    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"]
Jul 29 02:41:54.947067 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.947041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"]
Jul 29 02:41:54.960836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.960800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjkq\" (UniqueName: \"kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:54.960836 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.960847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:54.961047 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:54.960878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.061497 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.061451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjkq\" (UniqueName: \"kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.061676 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.061521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.061676 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.061576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.062020 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.061999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.062056 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.062007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.070236 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.070206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjkq\" (UniqueName: \"kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.203115 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.203000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:55.274918 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.274886    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerID="8115479707b53b547ec860e92f6eb2b442a3b4bdd1ffa308d7fca65b36b3ce98" exitCode=0
Jul 29 02:41:55.275109 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.274978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5" event={"ID":"ffb57b22-753c-476e-9524-6eb0249e3a7f","Type":"ContainerDied","Data":"8115479707b53b547ec860e92f6eb2b442a3b4bdd1ffa308d7fca65b36b3ce98"}
Jul 29 02:41:55.275109 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.275052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5" event={"ID":"ffb57b22-753c-476e-9524-6eb0249e3a7f","Type":"ContainerStarted","Data":"3a161b009425a736813fd4704701fb0f32eb3e500b6c2a79ba86050cc7c01da7"}
Jul 29 02:41:55.277271 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.277215    2560 generic.go:356] "Generic (PLEG): container finished" podID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerID="34890f4026fbf5c1247ad50facd978d64dd2c6a09e2eaaf36593b17eea2a44d3" exitCode=0
Jul 29 02:41:55.277403 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.277293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l" event={"ID":"f746c68e-ec57-43b5-aa71-b2976e6ba094","Type":"ContainerDied","Data":"34890f4026fbf5c1247ad50facd978d64dd2c6a09e2eaaf36593b17eea2a44d3"}
Jul 29 02:41:55.279176 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.279102    2560 generic.go:356] "Generic (PLEG): container finished" podID="284c354c-3de1-4142-b8b8-251a561fb916" containerID="0b2ec1a18d485181e14faf5a113c0dcc20d7ffd8a89f7d529e4bed2035449543" exitCode=0
Jul 29 02:41:55.279176 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.279146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv" event={"ID":"284c354c-3de1-4142-b8b8-251a561fb916","Type":"ContainerDied","Data":"0b2ec1a18d485181e14faf5a113c0dcc20d7ffd8a89f7d529e4bed2035449543"}
Jul 29 02:41:55.279321 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.279183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv" event={"ID":"284c354c-3de1-4142-b8b8-251a561fb916","Type":"ContainerStarted","Data":"e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e"}
Jul 29 02:41:55.350016 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:55.349985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"]
Jul 29 02:41:55.350509 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:41:55.350485    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bb4af8_f93f_4f48_a3cb_b84ac4d0cf1c.slice/crio-529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57 WatchSource:0}: Error finding container 529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57: Status 404 returned error can't find the container with id 529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57
Jul 29 02:41:56.288020 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.287984    2560 generic.go:356] "Generic (PLEG): container finished" podID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerID="55ecb8372b66050341b91a878f14fb9aff7a1bded8ef2e9733a8a3396274cd6e" exitCode=0
Jul 29 02:41:56.288436 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.288119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l" event={"ID":"f746c68e-ec57-43b5-aa71-b2976e6ba094","Type":"ContainerDied","Data":"55ecb8372b66050341b91a878f14fb9aff7a1bded8ef2e9733a8a3396274cd6e"}
Jul 29 02:41:56.290191 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.290160    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerID="2687773f071dbf976599ede2338cf3366ddf70a5c3a19c7869058667ab102de9" exitCode=0
Jul 29 02:41:56.290434 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.290264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5" event={"ID":"ffb57b22-753c-476e-9524-6eb0249e3a7f","Type":"ContainerDied","Data":"2687773f071dbf976599ede2338cf3366ddf70a5c3a19c7869058667ab102de9"}
Jul 29 02:41:56.292210 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.292180    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerID="f85bc2defe80a3abe89d4327e4aeb22dd776acdf1854483b4f0f67793e8c651a" exitCode=0
Jul 29 02:41:56.292347 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.292235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6" event={"ID":"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c","Type":"ContainerDied","Data":"f85bc2defe80a3abe89d4327e4aeb22dd776acdf1854483b4f0f67793e8c651a"}
Jul 29 02:41:56.292416 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:56.292367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6" event={"ID":"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c","Type":"ContainerStarted","Data":"529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57"}
Jul 29 02:41:57.299567 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.299470    2560 generic.go:356] "Generic (PLEG): container finished" podID="284c354c-3de1-4142-b8b8-251a561fb916" containerID="b13249a6aa5b7d7d2305957045fafab10c15755e8d3fa377c12a3238e68f810d" exitCode=0
Jul 29 02:41:57.299962 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.299552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv" event={"ID":"284c354c-3de1-4142-b8b8-251a561fb916","Type":"ContainerDied","Data":"b13249a6aa5b7d7d2305957045fafab10c15755e8d3fa377c12a3238e68f810d"}
Jul 29 02:41:57.301865 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.301837    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerID="0326f96b04b36482b277521746f0a1d9be52f3d2c2b2fbe796db83483e33a022" exitCode=0
Jul 29 02:41:57.301967 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.301923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5" event={"ID":"ffb57b22-753c-476e-9524-6eb0249e3a7f","Type":"ContainerDied","Data":"0326f96b04b36482b277521746f0a1d9be52f3d2c2b2fbe796db83483e33a022"}
Jul 29 02:41:57.303664 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.303642    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerID="9ba533f47a21862eb6fbdcf0c36b140430bbadaaf7ec22f1094673e2c42c0f18" exitCode=0
Jul 29 02:41:57.303760 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.303721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6" event={"ID":"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c","Type":"ContainerDied","Data":"9ba533f47a21862eb6fbdcf0c36b140430bbadaaf7ec22f1094673e2c42c0f18"}
Jul 29 02:41:57.447789 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.447754    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:57.585694 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.585599    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle\") pod \"f746c68e-ec57-43b5-aa71-b2976e6ba094\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") "
Jul 29 02:41:57.585694 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.585656    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbqst\" (UniqueName: \"kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst\") pod \"f746c68e-ec57-43b5-aa71-b2976e6ba094\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") "
Jul 29 02:41:57.585694 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.585682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util\") pod \"f746c68e-ec57-43b5-aa71-b2976e6ba094\" (UID: \"f746c68e-ec57-43b5-aa71-b2976e6ba094\") "
Jul 29 02:41:57.586326 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.586301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle" (OuterVolumeSpecName: "bundle") pod "f746c68e-ec57-43b5-aa71-b2976e6ba094" (UID: "f746c68e-ec57-43b5-aa71-b2976e6ba094"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:57.588469 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.588437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst" (OuterVolumeSpecName: "kube-api-access-rbqst") pod "f746c68e-ec57-43b5-aa71-b2976e6ba094" (UID: "f746c68e-ec57-43b5-aa71-b2976e6ba094"). InnerVolumeSpecName "kube-api-access-rbqst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:41:57.591335 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.591300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util" (OuterVolumeSpecName: "util") pod "f746c68e-ec57-43b5-aa71-b2976e6ba094" (UID: "f746c68e-ec57-43b5-aa71-b2976e6ba094"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:57.687297 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.687225    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:57.687297 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.687289    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbqst\" (UniqueName: \"kubernetes.io/projected/f746c68e-ec57-43b5-aa71-b2976e6ba094-kube-api-access-rbqst\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:57.687297 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:57.687302    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f746c68e-ec57-43b5-aa71-b2976e6ba094-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:58.311273 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.311215    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerID="44a35bebe8f6f34006b1884a314c8a6c5edecdbe5f967a79f231b77b4f74c6ff" exitCode=0
Jul 29 02:41:58.311668 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.311288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6" event={"ID":"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c","Type":"ContainerDied","Data":"44a35bebe8f6f34006b1884a314c8a6c5edecdbe5f967a79f231b77b4f74c6ff"}
Jul 29 02:41:58.313153 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.313131    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l"
Jul 29 02:41:58.313308 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.313147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l" event={"ID":"f746c68e-ec57-43b5-aa71-b2976e6ba094","Type":"ContainerDied","Data":"6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c"}
Jul 29 02:41:58.313308 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.313192    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e55e5d09a395c47c0dbe0ee6d549b4e84ba206bb6e04b1bdaf4f63f16b0bd3c"
Jul 29 02:41:58.315277 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.315229    2560 generic.go:356] "Generic (PLEG): container finished" podID="284c354c-3de1-4142-b8b8-251a561fb916" containerID="e6abb499170a0dbdb3e45f88b471f627c196ac5b017c7f3138f56aabddaf1c6a" exitCode=0
Jul 29 02:41:58.315426 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.315333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv" event={"ID":"284c354c-3de1-4142-b8b8-251a561fb916","Type":"ContainerDied","Data":"e6abb499170a0dbdb3e45f88b471f627c196ac5b017c7f3138f56aabddaf1c6a"}
Jul 29 02:41:58.450777 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.450749    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:58.597241 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.597131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle\") pod \"ffb57b22-753c-476e-9524-6eb0249e3a7f\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") "
Jul 29 02:41:58.597241 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.597213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util\") pod \"ffb57b22-753c-476e-9524-6eb0249e3a7f\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") "
Jul 29 02:41:58.597494 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.597284    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dgl6\" (UniqueName: \"kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6\") pod \"ffb57b22-753c-476e-9524-6eb0249e3a7f\" (UID: \"ffb57b22-753c-476e-9524-6eb0249e3a7f\") "
Jul 29 02:41:58.597815 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.597786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle" (OuterVolumeSpecName: "bundle") pod "ffb57b22-753c-476e-9524-6eb0249e3a7f" (UID: "ffb57b22-753c-476e-9524-6eb0249e3a7f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:58.599474 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.599449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6" (OuterVolumeSpecName: "kube-api-access-6dgl6") pod "ffb57b22-753c-476e-9524-6eb0249e3a7f" (UID: "ffb57b22-753c-476e-9524-6eb0249e3a7f"). InnerVolumeSpecName "kube-api-access-6dgl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:41:58.604641 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.604607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util" (OuterVolumeSpecName: "util") pod "ffb57b22-753c-476e-9524-6eb0249e3a7f" (UID: "ffb57b22-753c-476e-9524-6eb0249e3a7f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:58.698203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.698163    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:58.698203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.698195    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dgl6\" (UniqueName: \"kubernetes.io/projected/ffb57b22-753c-476e-9524-6eb0249e3a7f-kube-api-access-6dgl6\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:58.698203 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:58.698206    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffb57b22-753c-476e-9524-6eb0249e3a7f-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.322524 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.322492    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5"
Jul 29 02:41:59.322980 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.322523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5" event={"ID":"ffb57b22-753c-476e-9524-6eb0249e3a7f","Type":"ContainerDied","Data":"3a161b009425a736813fd4704701fb0f32eb3e500b6c2a79ba86050cc7c01da7"}
Jul 29 02:41:59.322980 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.322575    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a161b009425a736813fd4704701fb0f32eb3e500b6c2a79ba86050cc7c01da7"
Jul 29 02:41:59.481122 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.481095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:41:59.483366 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.483344    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:41:59.606133 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606033    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69z9c\" (UniqueName: \"kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c\") pod \"284c354c-3de1-4142-b8b8-251a561fb916\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") "
Jul 29 02:41:59.606133 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle\") pod \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") "
Jul 29 02:41:59.606133 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606140    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsjkq\" (UniqueName: \"kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq\") pod \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") "
Jul 29 02:41:59.606460 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util\") pod \"284c354c-3de1-4142-b8b8-251a561fb916\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") "
Jul 29 02:41:59.606460 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util\") pod \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\" (UID: \"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c\") "
Jul 29 02:41:59.606460 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle\") pod \"284c354c-3de1-4142-b8b8-251a561fb916\" (UID: \"284c354c-3de1-4142-b8b8-251a561fb916\") "
Jul 29 02:41:59.606785 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606746    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle" (OuterVolumeSpecName: "bundle") pod "284c354c-3de1-4142-b8b8-251a561fb916" (UID: "284c354c-3de1-4142-b8b8-251a561fb916"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:59.606888 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.606868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle" (OuterVolumeSpecName: "bundle") pod "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" (UID: "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:59.608371 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.608346    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c" (OuterVolumeSpecName: "kube-api-access-69z9c") pod "284c354c-3de1-4142-b8b8-251a561fb916" (UID: "284c354c-3de1-4142-b8b8-251a561fb916"). InnerVolumeSpecName "kube-api-access-69z9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:41:59.608640 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.608625    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq" (OuterVolumeSpecName: "kube-api-access-fsjkq") pod "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" (UID: "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c"). InnerVolumeSpecName "kube-api-access-fsjkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:41:59.611650 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.611615    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util" (OuterVolumeSpecName: "util") pod "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" (UID: "e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:59.612522 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.612499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util" (OuterVolumeSpecName: "util") pod "284c354c-3de1-4142-b8b8-251a561fb916" (UID: "284c354c-3de1-4142-b8b8-251a561fb916"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:41:59.707880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707840    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsjkq\" (UniqueName: \"kubernetes.io/projected/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-kube-api-access-fsjkq\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.707880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707873    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.707880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707884    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-util\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.707880 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707891    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/284c354c-3de1-4142-b8b8-251a561fb916-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.708143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707899    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69z9c\" (UniqueName: \"kubernetes.io/projected/284c354c-3de1-4142-b8b8-251a561fb916-kube-api-access-69z9c\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:41:59.708143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:41:59.707908    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c-bundle\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:42:00.329632 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.329603    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6"
Jul 29 02:42:00.330102 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.329635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6" event={"ID":"e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c","Type":"ContainerDied","Data":"529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57"}
Jul 29 02:42:00.330102 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.329686    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="529a847b7bfd4d4e2a3916ce462781ed08680526427047f4fe7d7fc39d048b57"
Jul 29 02:42:00.331572 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.331540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv" event={"ID":"284c354c-3de1-4142-b8b8-251a561fb916","Type":"ContainerDied","Data":"e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e"}
Jul 29 02:42:00.331709 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.331578    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv"
Jul 29 02:42:00.331709 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:00.331590    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0338ba916285b0ac90e03ff6b0d345359a7397b8279c7171de6e00084a62a1e"
Jul 29 02:42:40.183544 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"]
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183843    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183858    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183867    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183872    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183878    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183883    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183891    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183901    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183906    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183916    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183921    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183927    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183932    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183940    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183945    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183952    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="pull"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183962    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183969    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="extract"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183977    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183982    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183987    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.183991    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="util"
Jul 29 02:42:40.184031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.184043    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffb57b22-753c-476e-9524-6eb0249e3a7f" containerName="extract"
Jul 29 02:42:40.184785 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.184052    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f746c68e-ec57-43b5-aa71-b2976e6ba094" containerName="extract"
Jul 29 02:42:40.184785 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.184059    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c" containerName="extract"
Jul 29 02:42:40.184785 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.184065    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="284c354c-3de1-4142-b8b8-251a561fb916" containerName="extract"
Jul 29 02:42:40.188535 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.188509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.191535 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.191504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 02:42:40.191669 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.191584    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 02:42:40.191717 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.191675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nq5jt\""
Jul 29 02:42:40.200708 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.200676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"]
Jul 29 02:42:40.249732 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.249688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.249920 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.249752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8kr\" (UniqueName: \"kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.350223 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.350179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.350439 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.350291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8kr\" (UniqueName: \"kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.350670 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.350647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.363797 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.363759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8kr\" (UniqueName: \"kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.500539 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.500439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:40.641159 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.641131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"]
Jul 29 02:42:40.642956 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:42:40.642928    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147a1b32_15ad_4f39_bb09_61496f85d225.slice/crio-3a878aac4b58555dd939b848ddea95fe195903c9031f2e145383e21adb7147e4 WatchSource:0}: Error finding container 3a878aac4b58555dd939b848ddea95fe195903c9031f2e145383e21adb7147e4: Status 404 returned error can't find the container with id 3a878aac4b58555dd939b848ddea95fe195903c9031f2e145383e21adb7147e4
Jul 29 02:42:40.850938 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.850844    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"]
Jul 29 02:42:40.856430 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.856400    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"]
Jul 29 02:42:40.909595 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.909560    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"]
Jul 29 02:42:40.914470 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.914438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:40.917473 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.917447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7zvhw\""
Jul 29 02:42:40.924726 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.924692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"]
Jul 29 02:42:40.955525 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:40.955487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc45c\" (UniqueName: \"kubernetes.io/projected/89cd3f42-028c-4485-8dd2-00bb18fb0968-kube-api-access-lc45c\") pod \"limitador-operator-controller-manager-859d7b78bd-dlsh8\" (UID: \"89cd3f42-028c-4485-8dd2-00bb18fb0968\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:41.056618 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:41.056580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc45c\" (UniqueName: \"kubernetes.io/projected/89cd3f42-028c-4485-8dd2-00bb18fb0968-kube-api-access-lc45c\") pod \"limitador-operator-controller-manager-859d7b78bd-dlsh8\" (UID: \"89cd3f42-028c-4485-8dd2-00bb18fb0968\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:41.067999 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:41.067966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc45c\" (UniqueName: \"kubernetes.io/projected/89cd3f42-028c-4485-8dd2-00bb18fb0968-kube-api-access-lc45c\") pod \"limitador-operator-controller-manager-859d7b78bd-dlsh8\" (UID: \"89cd3f42-028c-4485-8dd2-00bb18fb0968\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:41.227762 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:41.227723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:41.546027 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:41.545998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"]
Jul 29 02:42:41.640780 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:42:41.640745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cd3f42_028c_4485_8dd2_00bb18fb0968.slice/crio-776ebf5c783f25b4319869dd1f58fa81fa8709323d28f0a008fc90a1625a2fc2 WatchSource:0}: Error finding container 776ebf5c783f25b4319869dd1f58fa81fa8709323d28f0a008fc90a1625a2fc2: Status 404 returned error can't find the container with id 776ebf5c783f25b4319869dd1f58fa81fa8709323d28f0a008fc90a1625a2fc2
Jul 29 02:42:42.553903 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:42.553855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8" event={"ID":"89cd3f42-028c-4485-8dd2-00bb18fb0968","Type":"ContainerStarted","Data":"776ebf5c783f25b4319869dd1f58fa81fa8709323d28f0a008fc90a1625a2fc2"}
Jul 29 02:42:43.562179 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:43.562128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8" event={"ID":"89cd3f42-028c-4485-8dd2-00bb18fb0968","Type":"ContainerStarted","Data":"a26e48914d1c7362f3183c34a4aa3df257d198a0df81c6192fe31188d257a995"}
Jul 29 02:42:43.562628 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:43.562286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:42:43.583354 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:43.583292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8" podStartSLOduration=2.15616953 podStartE2EDuration="3.583275344s" totalImagesPullingTime="1.427105814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:42:43.581031559 +0000 UTC m=+461.615748248" watchObservedRunningTime="2026-07-29 02:42:43.583275344 +0000 UTC m=+461.617992032"
Jul 29 02:42:45.574491 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.574443    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" containerName="manager" containerID="cri-o://c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc" gracePeriod=2
Jul 29 02:42:45.829432 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.829350    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:45.831864 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:42:45.831832    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" is forbidden: User \"system:node:ip-10-0-133-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-22.ec2.internal' and this object" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:45.902448 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.902414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume\") pod \"147a1b32-15ad-4f39-bb09-61496f85d225\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") "
Jul 29 02:42:45.902448 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.902459    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n8kr\" (UniqueName: \"kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr\") pod \"147a1b32-15ad-4f39-bb09-61496f85d225\" (UID: \"147a1b32-15ad-4f39-bb09-61496f85d225\") "
Jul 29 02:42:45.902751 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.902728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "147a1b32-15ad-4f39-bb09-61496f85d225" (UID: "147a1b32-15ad-4f39-bb09-61496f85d225"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:42:45.904590 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:45.904564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr" (OuterVolumeSpecName: "kube-api-access-4n8kr") pod "147a1b32-15ad-4f39-bb09-61496f85d225" (UID: "147a1b32-15ad-4f39-bb09-61496f85d225"). InnerVolumeSpecName "kube-api-access-4n8kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:42:46.003924 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.003881    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/147a1b32-15ad-4f39-bb09-61496f85d225-extensions-socket-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:42:46.003924 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.003914    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n8kr\" (UniqueName: \"kubernetes.io/projected/147a1b32-15ad-4f39-bb09-61496f85d225-kube-api-access-4n8kr\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:42:46.407914 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.407875    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" path="/var/lib/kubelet/pods/147a1b32-15ad-4f39-bb09-61496f85d225/volumes"
Jul 29 02:42:46.580699 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.580667    2560 generic.go:356] "Generic (PLEG): container finished" podID="147a1b32-15ad-4f39-bb09-61496f85d225" containerID="c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc" exitCode=2
Jul 29 02:42:46.581086 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.580713    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:46.581086 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.580776    2560 scope.go:117] "RemoveContainer" containerID="c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc"
Jul 29 02:42:46.585684 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:42:46.585643    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-wmw64\" is forbidden: User \"system:node:ip-10-0-133-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-22.ec2.internal' and this object" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wmw64"
Jul 29 02:42:46.590222 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.590203    2560 scope.go:117] "RemoveContainer" containerID="c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc"
Jul 29 02:42:46.590566 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:42:46.590543    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc\": container with ID starting with c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc not found: ID does not exist" containerID="c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc"
Jul 29 02:42:46.590632 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:46.590580    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc"} err="failed to get container status \"c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc\": rpc error: code = NotFound desc = could not find container \"c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc\": container with ID starting with c14517ee24b26188b910e6f1d0fc368dd86d887c70a77b4d44a8366a924e0bdc not found: ID does not exist"
Jul 29 02:42:54.570351 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:42:54.570318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dlsh8"
Jul 29 02:44:07.302879 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.302799    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:07.303383 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.303110    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" containerName="manager"
Jul 29 02:44:07.303383 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.303121    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" containerName="manager"
Jul 29 02:44:07.303383 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.303177    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="147a1b32-15ad-4f39-bb09-61496f85d225" containerName="manager"
Jul 29 02:44:07.306498 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.306470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.309017 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.308990    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 02:44:07.309130 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.308990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pfhrm\""
Jul 29 02:44:07.310230 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.310214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 02:44:07.317799 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.317772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:07.396524 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.396483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tll\" (UniqueName: \"kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.396724 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.396534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.497195 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.497155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tll\" (UniqueName: \"kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.497388 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.497227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.499779 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.499751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.512366 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.512323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tll\" (UniqueName: \"kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll\") pod \"maas-controller-869dfcbdf9-52f9v\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") " pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.618324 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.618185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:07.754657 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:07.754623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:07.757135 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:44:07.757103    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd2d0f2_1849_4a9e_9221_661428b69b64.slice/crio-4cb2eb49ae3a65a069bea8047b258868240d10c360a0d5b36106279b416a0f06 WatchSource:0}: Error finding container 4cb2eb49ae3a65a069bea8047b258868240d10c360a0d5b36106279b416a0f06: Status 404 returned error can't find the container with id 4cb2eb49ae3a65a069bea8047b258868240d10c360a0d5b36106279b416a0f06
Jul 29 02:44:08.004306 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:08.004265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" event={"ID":"ebd2d0f2-1849-4a9e-9221-661428b69b64","Type":"ContainerStarted","Data":"4cb2eb49ae3a65a069bea8047b258868240d10c360a0d5b36106279b416a0f06"}
Jul 29 02:44:11.027563 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:11.027521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" event={"ID":"ebd2d0f2-1849-4a9e-9221-661428b69b64","Type":"ContainerStarted","Data":"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"}
Jul 29 02:44:11.027999 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:11.027653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:11.062838 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:11.062782    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" podStartSLOduration=1.8144953259999999 podStartE2EDuration="4.062764104s" totalImagesPullingTime="2.248268778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:44:11.060962004 +0000 UTC m=+549.095678692" watchObservedRunningTime="2026-07-29 02:44:11.062764104 +0000 UTC m=+549.097480792"
Jul 29 02:44:21.747421 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:21.747382    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:21.748021 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:21.747613    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" podUID="ebd2d0f2-1849-4a9e-9221-661428b69b64" containerName="manager" containerID="cri-o://67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c" gracePeriod=30
Jul 29 02:44:21.749516 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:21.749491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:21.999720 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:21.999648    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:22.021812 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.021773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert\") pod \"ebd2d0f2-1849-4a9e-9221-661428b69b64\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") "
Jul 29 02:44:22.021977 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.021889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2tll\" (UniqueName: \"kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll\") pod \"ebd2d0f2-1849-4a9e-9221-661428b69b64\" (UID: \"ebd2d0f2-1849-4a9e-9221-661428b69b64\") "
Jul 29 02:44:22.024534 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.024482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ebd2d0f2-1849-4a9e-9221-661428b69b64" (UID: "ebd2d0f2-1849-4a9e-9221-661428b69b64"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:44:22.024534 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.024512    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll" (OuterVolumeSpecName: "kube-api-access-p2tll") pod "ebd2d0f2-1849-4a9e-9221-661428b69b64" (UID: "ebd2d0f2-1849-4a9e-9221-661428b69b64"). InnerVolumeSpecName "kube-api-access-p2tll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:44:22.091814 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.091772    2560 generic.go:356] "Generic (PLEG): container finished" podID="ebd2d0f2-1849-4a9e-9221-661428b69b64" containerID="67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c" exitCode=0
Jul 29 02:44:22.091814 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.091818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" event={"ID":"ebd2d0f2-1849-4a9e-9221-661428b69b64","Type":"ContainerDied","Data":"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"}
Jul 29 02:44:22.092078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.091826    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869dfcbdf9-52f9v"
Jul 29 02:44:22.092078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.091894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869dfcbdf9-52f9v" event={"ID":"ebd2d0f2-1849-4a9e-9221-661428b69b64","Type":"ContainerDied","Data":"4cb2eb49ae3a65a069bea8047b258868240d10c360a0d5b36106279b416a0f06"}
Jul 29 02:44:22.092078 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.091917    2560 scope.go:117] "RemoveContainer" containerID="67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"
Jul 29 02:44:22.104218 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.104199    2560 scope.go:117] "RemoveContainer" containerID="67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"
Jul 29 02:44:22.104575 ip-10-0-133-22 kubenswrapper[2560]: E0729 02:44:22.104552    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c\": container with ID starting with 67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c not found: ID does not exist" containerID="67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"
Jul 29 02:44:22.104625 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.104596    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c"} err="failed to get container status \"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c\": rpc error: code = NotFound desc = could not find container \"67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c\": container with ID starting with 67c2ac3fda23aa99cca2f6fae5ebe3295043c686604dcc47bdf88e13fefb490c not found: ID does not exist"
Jul 29 02:44:22.116905 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.116870    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:22.120608 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.120570    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-869dfcbdf9-52f9v"]
Jul 29 02:44:22.122890 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.122862    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2tll\" (UniqueName: \"kubernetes.io/projected/ebd2d0f2-1849-4a9e-9221-661428b69b64-kube-api-access-p2tll\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:44:22.122890 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.122892    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd2d0f2-1849-4a9e-9221-661428b69b64-webhook-cert\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 02:44:22.408852 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:22.408760    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd2d0f2-1849-4a9e-9221-661428b69b64" path="/var/lib/kubelet/pods/ebd2d0f2-1849-4a9e-9221-661428b69b64/volumes"
Jul 29 02:44:42.121798 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.121752    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"]
Jul 29 02:44:42.122427 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.122267    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd2d0f2-1849-4a9e-9221-661428b69b64" containerName="manager"
Jul 29 02:44:42.122427 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.122289    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd2d0f2-1849-4a9e-9221-661428b69b64" containerName="manager"
Jul 29 02:44:42.122427 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.122399    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd2d0f2-1849-4a9e-9221-661428b69b64" containerName="manager"
Jul 29 02:44:42.125448 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.125420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.128143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.128114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mtmzq\""
Jul 29 02:44:42.128143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.128141    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 02:44:42.133275 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.133235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"]
Jul 29 02:44:42.203157 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.203117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxb4\" (UniqueName: \"kubernetes.io/projected/6c6aae45-6b6a-4406-b7b9-705475b432a5-kube-api-access-5mxb4\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.203389 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.203175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c6aae45-6b6a-4406-b7b9-705475b432a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.304630 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.304593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxb4\" (UniqueName: \"kubernetes.io/projected/6c6aae45-6b6a-4406-b7b9-705475b432a5-kube-api-access-5mxb4\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.304824 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.304656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c6aae45-6b6a-4406-b7b9-705475b432a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.305332 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.305312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c6aae45-6b6a-4406-b7b9-705475b432a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.315512 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.315485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxb4\" (UniqueName: \"kubernetes.io/projected/6c6aae45-6b6a-4406-b7b9-705475b432a5-kube-api-access-5mxb4\") pod \"payload-pre-processing-687dbb6cf6-mschr\" (UID: \"6c6aae45-6b6a-4406-b7b9-705475b432a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.437001 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.436960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:42.582768 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:42.582740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"]
Jul 29 02:44:42.585099 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:44:42.585077    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6aae45_6b6a_4406_b7b9_705475b432a5.slice/crio-63bc30150dd609391c0a149fbe590007e1b5386a628d15d47a25d654a3d8c7aa WatchSource:0}: Error finding container 63bc30150dd609391c0a149fbe590007e1b5386a628d15d47a25d654a3d8c7aa: Status 404 returned error can't find the container with id 63bc30150dd609391c0a149fbe590007e1b5386a628d15d47a25d654a3d8c7aa
Jul 29 02:44:43.199535 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:43.199501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr" event={"ID":"6c6aae45-6b6a-4406-b7b9-705475b432a5","Type":"ContainerStarted","Data":"63bc30150dd609391c0a149fbe590007e1b5386a628d15d47a25d654a3d8c7aa"}
Jul 29 02:44:44.205633 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:44.205598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr" event={"ID":"6c6aae45-6b6a-4406-b7b9-705475b432a5","Type":"ContainerStarted","Data":"60b39cde17a2e07702e7b2663e23a7530a36d30761c134053d40f0df29ff3733"}
Jul 29 02:44:44.206003 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:44.205667    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:44:44.226713 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:44.226650    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr" podStartSLOduration=0.700268215 podStartE2EDuration="2.226632272s" totalImagesPullingTime="1.526364057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:44:44.224785874 +0000 UTC m=+582.259502564" watchObservedRunningTime="2026-07-29 02:44:44.226632272 +0000 UTC m=+582.261348963"
Jul 29 02:44:55.213932 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:44:55.213899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mschr"
Jul 29 02:45:00.130460 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.130413    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"]
Jul 29 02:45:00.133703 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.133683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"
Jul 29 02:45:00.136119 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.136093    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 02:45:00.140489 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.140454    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"]
Jul 29 02:45:00.144257 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.144222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"
Jul 29 02:45:00.283490 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:00.283466    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"]
Jul 29 02:45:00.285752 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:45:00.285717    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea137ffc_471c_4c69_a3ae_9ee66a89f206.slice/crio-551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9 WatchSource:0}: Error finding container 551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9: Status 404 returned error can't find the container with id 551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9
Jul 29 02:45:01.295043 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:01.295001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf" event={"ID":"ea137ffc-471c-4c69-a3ae-9ee66a89f206","Type":"ContainerStarted","Data":"551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9"}
Jul 29 02:45:02.501938 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:02.501911    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:45:02.502500 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:02.502484    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:45:03.308323 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.308285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf" event={"ID":"ea137ffc-471c-4c69-a3ae-9ee66a89f206","Type":"ContainerStarted","Data":"7ffc5585a7d3d18e60d6defdfdd1f37d6970cf620f33b75c6f43263d462c2c33"}
Jul 29 02:45:03.320342 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.320308    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"]
Jul 29 02:45:03.323789 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.323768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.326399 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.326366    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 02:45:03.326555 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.326480    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 02:45:03.326555 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.326500    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5lxvp\""
Jul 29 02:45:03.327671 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.327648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 02:45:03.329968 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.329923    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf" podStartSLOduration=1.076135893 podStartE2EDuration="3.329907198s" totalImagesPullingTime="2.253771305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:03.328076907 +0000 UTC m=+601.362793597" watchObservedRunningTime="2026-07-29 02:45:03.329907198 +0000 UTC m=+601.364623883"
Jul 29 02:45:03.335214 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.335185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"]
Jul 29 02:45:03.392358 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.392358 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.392570 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.392570 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh998\" (UniqueName: \"kubernetes.io/projected/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-kube-api-access-mh998\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.392570 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.392570 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.392490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.492968 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.492932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493131 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.492992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493131 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493131 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh998\" (UniqueName: \"kubernetes.io/projected/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-kube-api-access-mh998\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493131 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493354 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493567 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493567 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.493821 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.493796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.495232 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.495212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.495602 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.495583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.500901 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.500882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh998\" (UniqueName: \"kubernetes.io/projected/b20aa0b2-bb5b-4a29-8bd4-8fa779409a55-kube-api-access-mh998\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr\" (UID: \"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.636170 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.636082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:03.772322 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:03.772292    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"]
Jul 29 02:45:03.774612 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:45:03.774585    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20aa0b2_bb5b_4a29_8bd4_8fa779409a55.slice/crio-71cbb74a0c1ab96e671a3fb2f94ae444a4acbacb7a9673ba53ea7f5c9660fd2b WatchSource:0}: Error finding container 71cbb74a0c1ab96e671a3fb2f94ae444a4acbacb7a9673ba53ea7f5c9660fd2b: Status 404 returned error can't find the container with id 71cbb74a0c1ab96e671a3fb2f94ae444a4acbacb7a9673ba53ea7f5c9660fd2b
Jul 29 02:45:04.316159 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:04.316114    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea137ffc-471c-4c69-a3ae-9ee66a89f206" containerID="7ffc5585a7d3d18e60d6defdfdd1f37d6970cf620f33b75c6f43263d462c2c33" exitCode=0
Jul 29 02:45:04.316380 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:04.316193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf" event={"ID":"ea137ffc-471c-4c69-a3ae-9ee66a89f206","Type":"ContainerDied","Data":"7ffc5585a7d3d18e60d6defdfdd1f37d6970cf620f33b75c6f43263d462c2c33"}
Jul 29 02:45:04.317699 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:04.317663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr" event={"ID":"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55","Type":"ContainerStarted","Data":"71cbb74a0c1ab96e671a3fb2f94ae444a4acbacb7a9673ba53ea7f5c9660fd2b"}
Jul 29 02:45:05.325234 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:05.325196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr" event={"ID":"b20aa0b2-bb5b-4a29-8bd4-8fa779409a55","Type":"ContainerStarted","Data":"ffca7e9638283911777a6845d09d48d29ea0370f8e882632486e38d6f2ca2e69"}
Jul 29 02:45:05.344075 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:05.342547    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr" podStartSLOduration=1.280768985 podStartE2EDuration="2.342524545s" totalImagesPullingTime="1.06175556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:05.341747076 +0000 UTC m=+603.376463781" watchObservedRunningTime="2026-07-29 02:45:05.342524545 +0000 UTC m=+603.377241237"
Jul 29 02:45:05.464636 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:05.464598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"
Jul 29 02:45:06.332425 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:06.332392    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"
Jul 29 02:45:06.332859 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:06.332427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf" event={"ID":"ea137ffc-471c-4c69-a3ae-9ee66a89f206","Type":"ContainerDied","Data":"551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9"}
Jul 29 02:45:06.332859 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:06.332518    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="551c69b82150f6ad75370728afac5e9383d4a4e21619a47d1cd0bee9654fb5f9"
Jul 29 02:45:13.636631 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:13.636592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:13.637052 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:13.636659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:13.649444 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:13.649410    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:14.384383 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:14.384348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr"
Jul 29 02:45:36.349761 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.349674    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"]
Jul 29 02:45:36.350335 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.350069    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea137ffc-471c-4c69-a3ae-9ee66a89f206" containerName="cleanup"
Jul 29 02:45:36.350335 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.350083    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea137ffc-471c-4c69-a3ae-9ee66a89f206" containerName="cleanup"
Jul 29 02:45:36.350335 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.350143    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea137ffc-471c-4c69-a3ae-9ee66a89f206" containerName="cleanup"
Jul 29 02:45:36.354223 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.354202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.356723 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.356699    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 02:45:36.365329 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.365293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"]
Jul 29 02:45:36.489929 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.489884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.490110 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.490023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.490110 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.490048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.490110 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.490086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.490228 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.490148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.490228 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.490176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs24v\" (UniqueName: \"kubernetes.io/projected/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-kube-api-access-qs24v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591408 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591408 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591756 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs24v\" (UniqueName: \"kubernetes.io/projected/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-kube-api-access-qs24v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591756 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591756 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591756 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.591965 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.592036 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.591973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.593771 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.593747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.593855 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.593841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.600564 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.600511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs24v\" (UniqueName: \"kubernetes.io/projected/8f0c856e-c4d0-4488-a01a-9f38e3184bdc-kube-api-access-qs24v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl\" (UID: \"8f0c856e-c4d0-4488-a01a-9f38e3184bdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.664659 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.664612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:36.803031 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.803006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"]
Jul 29 02:45:36.804278 ip-10-0-133-22 kubenswrapper[2560]: W0729 02:45:36.804227    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0c856e_c4d0_4488_a01a_9f38e3184bdc.slice/crio-b31f02cd5907735a2cd2d3c7d9a9970d517e81411f051d7c57d1b3bfa2cdb6e3 WatchSource:0}: Error finding container b31f02cd5907735a2cd2d3c7d9a9970d517e81411f051d7c57d1b3bfa2cdb6e3: Status 404 returned error can't find the container with id b31f02cd5907735a2cd2d3c7d9a9970d517e81411f051d7c57d1b3bfa2cdb6e3
Jul 29 02:45:36.805950 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:36.805933    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:45:37.501817 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:37.501783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl" event={"ID":"8f0c856e-c4d0-4488-a01a-9f38e3184bdc","Type":"ContainerStarted","Data":"eb24b660c48752e2b8e1f35986538641025f6dc79aca518a14420fccd2b4d80e"}
Jul 29 02:45:37.502191 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:37.501836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl" event={"ID":"8f0c856e-c4d0-4488-a01a-9f38e3184bdc","Type":"ContainerStarted","Data":"b31f02cd5907735a2cd2d3c7d9a9970d517e81411f051d7c57d1b3bfa2cdb6e3"}
Jul 29 02:45:37.520168 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:37.520109    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl" podStartSLOduration=1.320770657 podStartE2EDuration="1.520087334s" totalImagesPullingTime="199.316677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:37.517944359 +0000 UTC m=+635.552661087" watchObservedRunningTime="2026-07-29 02:45:37.520087334 +0000 UTC m=+635.554804021"
Jul 29 02:45:46.665136 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:46.665094    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:46.665682 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:46.665198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:46.677773 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:46.677742    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:45:47.567482 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:45:47.567453    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl"
Jul 29 02:50:02.542143 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:50:02.542105    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:50:02.543882 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:50:02.543859    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:55:02.578479 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:55:02.578446    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 02:55:02.579042 ip-10-0-133-22 kubenswrapper[2560]: I0729 02:55:02.578561    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:00:00.141812 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.141775    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"]
Jul 29 03:00:00.145181 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.145162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"
Jul 29 03:00:00.147984 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.147960    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:00:00.152607 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.152560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"]
Jul 29 03:00:00.157083 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.157064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"
Jul 29 03:00:00.297285 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:00.297237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"]
Jul 29 03:00:00.299234 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:00:00.299208    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa04587_aa93_4d0d_8458_a965f5a27d13.slice/crio-b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5 WatchSource:0}: Error finding container b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5: Status 404 returned error can't find the container with id b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5
Jul 29 03:00:01.093960 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:01.093919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p" event={"ID":"6fa04587-aa93-4d0d-8458-a965f5a27d13","Type":"ContainerStarted","Data":"e599f5aaa26c7aae268659b2d489312332fab8e809e612a630852e53150387f8"}
Jul 29 03:00:01.094145 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:01.093974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p" event={"ID":"6fa04587-aa93-4d0d-8458-a965f5a27d13","Type":"ContainerStarted","Data":"b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5"}
Jul 29 03:00:01.110796 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:01.110742    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p" podStartSLOduration=1.110723944 podStartE2EDuration="1.110723944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:00:01.108740228 +0000 UTC m=+1499.143456920" watchObservedRunningTime="2026-07-29 03:00:01.110723944 +0000 UTC m=+1499.145440634"
Jul 29 03:00:02.101747 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:02.101714    2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa04587-aa93-4d0d-8458-a965f5a27d13" containerID="e599f5aaa26c7aae268659b2d489312332fab8e809e612a630852e53150387f8" exitCode=0
Jul 29 03:00:02.102162 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:02.101829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p" event={"ID":"6fa04587-aa93-4d0d-8458-a965f5a27d13","Type":"ContainerDied","Data":"e599f5aaa26c7aae268659b2d489312332fab8e809e612a630852e53150387f8"}
Jul 29 03:00:02.611962 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:02.611934    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:00:02.614843 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:02.614812    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:00:03.249222 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:03.249191    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"
Jul 29 03:00:04.114988 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:04.114949    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p"
Jul 29 03:00:04.115176 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:04.114988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754900-sl42p" event={"ID":"6fa04587-aa93-4d0d-8458-a965f5a27d13","Type":"ContainerDied","Data":"b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5"}
Jul 29 03:00:04.115176 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:00:04.115042    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b50b5b4674cf77258ba9e5ecfe543fbd8a045d2c2ac141d204804ce76854f3a5"
Jul 29 03:02:39.290634 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.290593    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:02:39.293031 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.290963    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa04587-aa93-4d0d-8458-a965f5a27d13" containerName="cleanup"
Jul 29 03:02:39.293031 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.290973    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa04587-aa93-4d0d-8458-a965f5a27d13" containerName="cleanup"
Jul 29 03:02:39.293031 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.291034    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa04587-aa93-4d0d-8458-a965f5a27d13" containerName="cleanup"
Jul 29 03:02:39.293913 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.293898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.296834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.296811    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-bf957620\""
Jul 29 03:02:39.296931 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.296918    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-bf957620-dockercfg-p5vxj\""
Jul 29 03:02:39.305651 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.305626    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:02:39.358832 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.358793    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:02:39.362182 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.362161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.383386 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.383348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:02:39.388644 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.388607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.388849 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.388667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7w8\" (UniqueName: \"kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.489433 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.489390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79k9l\" (UniqueName: \"kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.489433 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.489438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.489674 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.489503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.489674 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.489600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7w8\" (UniqueName: \"kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.490151 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.490130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.500010 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.499982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7w8\" (UniqueName: \"kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8\") pod \"payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.590298 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.590159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.590461 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.590306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79k9l\" (UniqueName: \"kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.591011 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.590991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.603852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.603821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79k9l\" (UniqueName: \"kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l\") pod \"payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") " pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.604018 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.603970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.673598 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.673519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.762325 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.762295    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:02:39.764662 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:02:39.764608    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0099a9_d4c0_4286_92cd_9da1fa0047bb.slice/crio-3480d37b10638b42c0fe5d089f4e2f9faf02bc15717171bc61c507a1ffa9af8b WatchSource:0}: Error finding container 3480d37b10638b42c0fe5d089f4e2f9faf02bc15717171bc61c507a1ffa9af8b: Status 404 returned error can't find the container with id 3480d37b10638b42c0fe5d089f4e2f9faf02bc15717171bc61c507a1ffa9af8b
Jul 29 03:02:39.842427 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.842399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:02:39.845048 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:02:39.845018    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c6dae3_807f_4a99_8d75_1e364b81f743.slice/crio-71990b252d7f1903e1f401df035e910213e976fdb5fbdde9f1bd241a9f37863e WatchSource:0}: Error finding container 71990b252d7f1903e1f401df035e910213e976fdb5fbdde9f1bd241a9f37863e: Status 404 returned error can't find the container with id 71990b252d7f1903e1f401df035e910213e976fdb5fbdde9f1bd241a9f37863e
Jul 29 03:02:39.943356 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.943315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" event={"ID":"c8c6dae3-807f-4a99-8d75-1e364b81f743","Type":"ContainerStarted","Data":"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"}
Jul 29 03:02:39.943554 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.943386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:02:39.943554 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.943413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" event={"ID":"c8c6dae3-807f-4a99-8d75-1e364b81f743","Type":"ContainerStarted","Data":"71990b252d7f1903e1f401df035e910213e976fdb5fbdde9f1bd241a9f37863e"}
Jul 29 03:02:39.944957 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.944921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" event={"ID":"ab0099a9-d4c0-4286-92cd-9da1fa0047bb","Type":"ContainerStarted","Data":"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"}
Jul 29 03:02:39.945098 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.944969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" event={"ID":"ab0099a9-d4c0-4286-92cd-9da1fa0047bb","Type":"ContainerStarted","Data":"3480d37b10638b42c0fe5d089f4e2f9faf02bc15717171bc61c507a1ffa9af8b"}
Jul 29 03:02:39.945098 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.945000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:39.964045 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.963992    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" podStartSLOduration=0.963974939 podStartE2EDuration="963.974939ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:02:39.963108494 +0000 UTC m=+1657.997825185" watchObservedRunningTime="2026-07-29 03:02:39.963974939 +0000 UTC m=+1657.998691626"
Jul 29 03:02:39.990325 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:39.990268    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" podStartSLOduration=0.990228345 podStartE2EDuration="990.228345ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:02:39.987829238 +0000 UTC m=+1658.022545953" watchObservedRunningTime="2026-07-29 03:02:39.990228345 +0000 UTC m=+1658.024945109"
Jul 29 03:02:50.952705 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:50.952671    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:02:50.953093 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:02:50.952757    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:03:03.727737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.727694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"]
Jul 29 03:03:03.731170 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.731147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:03.734054 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.734027    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:03:03.734054 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.734047    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:03:03.740098 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.740070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"]
Jul 29 03:03:03.800010 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.799968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bf957620-ptpr4\" (UID: \"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:03.900683 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.900638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bf957620-ptpr4\" (UID: \"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:03.901345 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:03.901324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bf957620-ptpr4\" (UID: \"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:04.042883 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:04.042784    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:04.184220 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:04.184189    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"]
Jul 29 03:03:04.185455 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:04.185427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3926b2_d7e3_4e42_b8b7_211fc95f1c19.slice/crio-9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79 WatchSource:0}: Error finding container 9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79: Status 404 returned error can't find the container with id 9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79
Jul 29 03:03:05.088741 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:05.088681    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" containerID="7275429881d097abb2fc730213e16f6427ee1cda409da38f89d58819a1fc64b5" exitCode=0
Jul 29 03:03:05.089167 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:05.088772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4" event={"ID":"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19","Type":"ContainerDied","Data":"7275429881d097abb2fc730213e16f6427ee1cda409da38f89d58819a1fc64b5"}
Jul 29 03:03:05.089167 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:05.088874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4" event={"ID":"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19","Type":"ContainerStarted","Data":"9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79"}
Jul 29 03:03:06.243112 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:06.243081    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:06.321605 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:06.321552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca\") pod \"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19\" (UID: \"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19\") "
Jul 29 03:03:06.321989 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:06.321961    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" (UID: "9c3926b2-d7e3-4e42-b8b7-211fc95f1c19"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:06.423207 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:06.423166    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:07.101103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:07.101075    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"
Jul 29 03:03:07.101103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:07.101084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4" event={"ID":"9c3926b2-d7e3-4e42-b8b7-211fc95f1c19","Type":"ContainerDied","Data":"9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79"}
Jul 29 03:03:07.101343 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:07.101134    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9772d8dea781efb3127ad2eb6d9edd921eff8c297492c8f6cd174ab402d67b79"
Jul 29 03:03:09.124684 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.124645    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:03:09.125597 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.124970    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" podUID="c8c6dae3-807f-4a99-8d75-1e364b81f743" containerName="payload-processing" containerID="cri-o://cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261" gracePeriod=30
Jul 29 03:03:09.132983 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.132949    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:03:09.133329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.133296    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" podUID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" containerName="payload-pre-processing" containerID="cri-o://e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b" gracePeriod=30
Jul 29 03:03:09.298624 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.298586    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"]
Jul 29 03:03:09.301338 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.301306    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bf957620-ptpr4"]
Jul 29 03:03:09.426498 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.426466    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:03:09.430230 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.430135    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:03:09.549498 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume\") pod \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") "
Jul 29 03:03:09.549680 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549530    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z7w8\" (UniqueName: \"kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8\") pod \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\" (UID: \"ab0099a9-d4c0-4286-92cd-9da1fa0047bb\") "
Jul 29 03:03:09.549680 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549560    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume\") pod \"c8c6dae3-807f-4a99-8d75-1e364b81f743\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") "
Jul 29 03:03:09.549680 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549587    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79k9l\" (UniqueName: \"kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l\") pod \"c8c6dae3-807f-4a99-8d75-1e364b81f743\" (UID: \"c8c6dae3-807f-4a99-8d75-1e364b81f743\") "
Jul 29 03:03:09.549965 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab0099a9-d4c0-4286-92cd-9da1fa0047bb" (UID: "ab0099a9-d4c0-4286-92cd-9da1fa0047bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:09.550028 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.549996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8c6dae3-807f-4a99-8d75-1e364b81f743" (UID: "c8c6dae3-807f-4a99-8d75-1e364b81f743"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:09.552099 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.552060    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l" (OuterVolumeSpecName: "kube-api-access-79k9l") pod "c8c6dae3-807f-4a99-8d75-1e364b81f743" (UID: "c8c6dae3-807f-4a99-8d75-1e364b81f743"). InnerVolumeSpecName "kube-api-access-79k9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:03:09.552271 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.552074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8" (OuterVolumeSpecName: "kube-api-access-2z7w8") pod "ab0099a9-d4c0-4286-92cd-9da1fa0047bb" (UID: "ab0099a9-d4c0-4286-92cd-9da1fa0047bb"). InnerVolumeSpecName "kube-api-access-2z7w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:03:09.650563 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.650467    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:09.650563 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.650501    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z7w8\" (UniqueName: \"kubernetes.io/projected/ab0099a9-d4c0-4286-92cd-9da1fa0047bb-kube-api-access-2z7w8\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:09.650563 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.650513    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c6dae3-807f-4a99-8d75-1e364b81f743-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:09.650563 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:09.650526    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79k9l\" (UniqueName: \"kubernetes.io/projected/c8c6dae3-807f-4a99-8d75-1e364b81f743-kube-api-access-79k9l\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:10.123333 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.123293    2560 generic.go:356] "Generic (PLEG): container finished" podID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" containerID="e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b" exitCode=0
Jul 29 03:03:10.123603 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.123385    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"
Jul 29 03:03:10.123603 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.123408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" event={"ID":"ab0099a9-d4c0-4286-92cd-9da1fa0047bb","Type":"ContainerDied","Data":"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"}
Jul 29 03:03:10.123603 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.123490    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt" event={"ID":"ab0099a9-d4c0-4286-92cd-9da1fa0047bb","Type":"ContainerDied","Data":"3480d37b10638b42c0fe5d089f4e2f9faf02bc15717171bc61c507a1ffa9af8b"}
Jul 29 03:03:10.123603 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.123587    2560 scope.go:117] "RemoveContainer" containerID="e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"
Jul 29 03:03:10.124816 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.124788    2560 generic.go:356] "Generic (PLEG): container finished" podID="c8c6dae3-807f-4a99-8d75-1e364b81f743" containerID="cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261" exitCode=0
Jul 29 03:03:10.124963 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.124820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" event={"ID":"c8c6dae3-807f-4a99-8d75-1e364b81f743","Type":"ContainerDied","Data":"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"}
Jul 29 03:03:10.124963 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.124849    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"
Jul 29 03:03:10.124963 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.124872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth" event={"ID":"c8c6dae3-807f-4a99-8d75-1e364b81f743","Type":"ContainerDied","Data":"71990b252d7f1903e1f401df035e910213e976fdb5fbdde9f1bd241a9f37863e"}
Jul 29 03:03:10.135285 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.135162    2560 scope.go:117] "RemoveContainer" containerID="e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"
Jul 29 03:03:10.135543 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:03:10.135523    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b\": container with ID starting with e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b not found: ID does not exist" containerID="e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"
Jul 29 03:03:10.135695 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.135556    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b"} err="failed to get container status \"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b\": rpc error: code = NotFound desc = could not find container \"e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b\": container with ID starting with e360a73ef9fb8df6a4eb3bb711a900c311817ddbc2a8eca7d948ffe53e5a9f5b not found: ID does not exist"
Jul 29 03:03:10.135695 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.135576    2560 scope.go:117] "RemoveContainer" containerID="cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"
Jul 29 03:03:10.148772 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.148742    2560 scope.go:117] "RemoveContainer" containerID="cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"
Jul 29 03:03:10.149127 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:03:10.149106    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261\": container with ID starting with cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261 not found: ID does not exist" containerID="cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"
Jul 29 03:03:10.149182 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.149136    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261"} err="failed to get container status \"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261\": rpc error: code = NotFound desc = could not find container \"cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261\": container with ID starting with cac5054a85313b33c544159f0b191f77ebf162763e59883a862a3d499f964261 not found: ID does not exist"
Jul 29 03:03:10.159230 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.159169    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:03:10.161916 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.161886    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bf957620-86bbfd7cc6-sscmt"]
Jul 29 03:03:10.175389 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.175347    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:03:10.181200 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.181150    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bf957620-5f7cfd4fc4-dqjth"]
Jul 29 03:03:10.408911 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.408810    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" path="/var/lib/kubelet/pods/9c3926b2-d7e3-4e42-b8b7-211fc95f1c19/volumes"
Jul 29 03:03:10.409320 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.409299    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" path="/var/lib/kubelet/pods/ab0099a9-d4c0-4286-92cd-9da1fa0047bb/volumes"
Jul 29 03:03:10.409710 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:10.409691    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c6dae3-807f-4a99-8d75-1e364b81f743" path="/var/lib/kubelet/pods/c8c6dae3-807f-4a99-8d75-1e364b81f743/volumes"
Jul 29 03:03:14.676256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676220    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c6dae3-807f-4a99-8d75-1e364b81f743" containerName="payload-processing"
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676575    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c6dae3-807f-4a99-8d75-1e364b81f743" containerName="payload-processing"
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676602    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" containerName="revoke-keys"
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676608    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" containerName="revoke-keys"
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" containerName="payload-pre-processing"
Jul 29 03:03:14.676632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676624    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" containerName="payload-pre-processing"
Jul 29 03:03:14.676834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676676    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0099a9-d4c0-4286-92cd-9da1fa0047bb" containerName="payload-pre-processing"
Jul 29 03:03:14.676834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676683    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c6dae3-807f-4a99-8d75-1e364b81f743" containerName="payload-processing"
Jul 29 03:03:14.676834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.676693    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3926b2-d7e3-4e42-b8b7-211fc95f1c19" containerName="revoke-keys"
Jul 29 03:03:14.686854 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.686817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.692394 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.692368    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ab95c5e9\""
Jul 29 03:03:14.693148 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.693122    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-ab95c5e9-dockercfg-hk7q8\""
Jul 29 03:03:14.698737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.698708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:14.736530 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.736481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:14.740716 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.740681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.750992 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.750961    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:14.799553 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.799514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.799728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.799572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.799728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.799646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqkn\" (UniqueName: \"kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.799801 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.799751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xsbf\" (UniqueName: \"kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.900952 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.900913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqkn\" (UniqueName: \"kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.901123 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.900982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xsbf\" (UniqueName: \"kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.901123 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.901001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.901123 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.901036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.901943 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.901921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.901991 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.901921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.909402 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.909369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqkn\" (UniqueName: \"kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn\") pod \"payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") " pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:14.909402 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.909370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xsbf\" (UniqueName: \"kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf\") pod \"payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:14.999145 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:14.999048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:15.055269 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:15.055214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:15.156878 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:15.156841    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:15.157793 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:15.157769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66eb9624_c463_43e4_891e_7b78dc13bc2f.slice/crio-dec120687b8d2871065967fb7f084722b18e0f2229b40988dbc4cbdb9223e8ed WatchSource:0}: Error finding container dec120687b8d2871065967fb7f084722b18e0f2229b40988dbc4cbdb9223e8ed: Status 404 returned error can't find the container with id dec120687b8d2871065967fb7f084722b18e0f2229b40988dbc4cbdb9223e8ed
Jul 29 03:03:15.215993 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:15.215963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:15.217933 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:15.217905    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ccae53_32da_4168_9e7f_db82d33ec2ba.slice/crio-c9b86a3a047700d4086d1c48d7e4fbe3d1961cc2847a0b5516149f897fe96373 WatchSource:0}: Error finding container c9b86a3a047700d4086d1c48d7e4fbe3d1961cc2847a0b5516149f897fe96373: Status 404 returned error can't find the container with id c9b86a3a047700d4086d1c48d7e4fbe3d1961cc2847a0b5516149f897fe96373
Jul 29 03:03:16.163153 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.163120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" event={"ID":"71ccae53-32da-4168-9e7f-db82d33ec2ba","Type":"ContainerStarted","Data":"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"}
Jul 29 03:03:16.163679 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.163182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" event={"ID":"71ccae53-32da-4168-9e7f-db82d33ec2ba","Type":"ContainerStarted","Data":"c9b86a3a047700d4086d1c48d7e4fbe3d1961cc2847a0b5516149f897fe96373"}
Jul 29 03:03:16.163679 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.163214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:16.164717 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.164689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" event={"ID":"66eb9624-c463-43e4-891e-7b78dc13bc2f","Type":"ContainerStarted","Data":"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"}
Jul 29 03:03:16.164842 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.164744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" event={"ID":"66eb9624-c463-43e4-891e-7b78dc13bc2f","Type":"ContainerStarted","Data":"dec120687b8d2871065967fb7f084722b18e0f2229b40988dbc4cbdb9223e8ed"}
Jul 29 03:03:16.164842 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.164770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:16.181172 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.181056    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" podStartSLOduration=2.181035152 podStartE2EDuration="2.181035152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:03:16.178097001 +0000 UTC m=+1694.212813702" watchObservedRunningTime="2026-07-29 03:03:16.181035152 +0000 UTC m=+1694.215751819"
Jul 29 03:03:16.196070 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:16.195977    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" podStartSLOduration=2.195955819 podStartE2EDuration="2.195955819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:03:16.193724808 +0000 UTC m=+1694.228441499" watchObservedRunningTime="2026-07-29 03:03:16.195955819 +0000 UTC m=+1694.230672509"
Jul 29 03:03:27.172803 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:27.172730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:27.173181 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:27.173013    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:38.482401 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.482357    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"]
Jul 29 03:03:38.489410 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.489374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:38.492493 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.492462    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:03:38.492808 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.492781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:03:38.494715 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.494685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"]
Jul 29 03:03:38.627316 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.627276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb\" (UID: \"ad65253c-b210-45e7-90f6-7e855bb0f62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:38.728086 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.728049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb\" (UID: \"ad65253c-b210-45e7-90f6-7e855bb0f62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:38.728703 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.728682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb\" (UID: \"ad65253c-b210-45e7-90f6-7e855bb0f62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:38.803329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.803210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:38.942759 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:38.942720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"]
Jul 29 03:03:38.945920 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:38.945892    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad65253c_b210_45e7_90f6_7e855bb0f62e.slice/crio-4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575 WatchSource:0}: Error finding container 4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575: Status 404 returned error can't find the container with id 4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575
Jul 29 03:03:39.296289 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:39.296238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb" event={"ID":"ad65253c-b210-45e7-90f6-7e855bb0f62e","Type":"ContainerStarted","Data":"06634938216f210532db2a35c3a9623a683fd0ff7e139706df79d7a696cbe3a0"}
Jul 29 03:03:39.296439 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:39.296301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb" event={"ID":"ad65253c-b210-45e7-90f6-7e855bb0f62e","Type":"ContainerStarted","Data":"4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575"}
Jul 29 03:03:39.315802 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:39.315748    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb" podStartSLOduration=1.315730663 podStartE2EDuration="1.315730663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:03:39.312346404 +0000 UTC m=+1717.347063097" watchObservedRunningTime="2026-07-29 03:03:39.315730663 +0000 UTC m=+1717.350447406"
Jul 29 03:03:40.303322 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:40.303288    2560 generic.go:356] "Generic (PLEG): container finished" podID="ad65253c-b210-45e7-90f6-7e855bb0f62e" containerID="06634938216f210532db2a35c3a9623a683fd0ff7e139706df79d7a696cbe3a0" exitCode=0
Jul 29 03:03:40.303742 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:40.303383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb" event={"ID":"ad65253c-b210-45e7-90f6-7e855bb0f62e","Type":"ContainerDied","Data":"06634938216f210532db2a35c3a9623a683fd0ff7e139706df79d7a696cbe3a0"}
Jul 29 03:03:41.446623 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:41.446594    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:41.550666 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:41.550616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca\") pod \"ad65253c-b210-45e7-90f6-7e855bb0f62e\" (UID: \"ad65253c-b210-45e7-90f6-7e855bb0f62e\") "
Jul 29 03:03:41.550996 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:41.550955    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad65253c-b210-45e7-90f6-7e855bb0f62e" (UID: "ad65253c-b210-45e7-90f6-7e855bb0f62e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:41.651543 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:41.651442    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65253c-b210-45e7-90f6-7e855bb0f62e-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:42.317970 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.317935    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"
Jul 29 03:03:42.317970 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.317939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb" event={"ID":"ad65253c-b210-45e7-90f6-7e855bb0f62e","Type":"ContainerDied","Data":"4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575"}
Jul 29 03:03:42.317970 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.318018    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d570fe918e1e2bb3e66e07cee5a71f0dbe6f19a0c8c60b8b7eacfc22d80c575"
Jul 29 03:03:42.396209 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.396160    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:42.396479 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.396450    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" podUID="71ccae53-32da-4168-9e7f-db82d33ec2ba" containerName="payload-processing" containerID="cri-o://2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0" gracePeriod=30
Jul 29 03:03:42.410466 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.410434    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:42.410733 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.410703    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" podUID="66eb9624-c463-43e4-891e-7b78dc13bc2f" containerName="payload-pre-processing" containerID="cri-o://ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb" gracePeriod=30
Jul 29 03:03:42.670304 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.670275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:42.679643 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.679565    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"]
Jul 29 03:03:42.683142 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.682065    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ab95c5e9-bsdvb"]
Jul 29 03:03:42.710921 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.710888    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:42.758501 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.758464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xsbf\" (UniqueName: \"kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf\") pod \"66eb9624-c463-43e4-891e-7b78dc13bc2f\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") "
Jul 29 03:03:42.758501 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.758509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmqkn\" (UniqueName: \"kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn\") pod \"71ccae53-32da-4168-9e7f-db82d33ec2ba\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") "
Jul 29 03:03:42.758780 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.758535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume\") pod \"66eb9624-c463-43e4-891e-7b78dc13bc2f\" (UID: \"66eb9624-c463-43e4-891e-7b78dc13bc2f\") "
Jul 29 03:03:42.758780 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.758563    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume\") pod \"71ccae53-32da-4168-9e7f-db82d33ec2ba\" (UID: \"71ccae53-32da-4168-9e7f-db82d33ec2ba\") "
Jul 29 03:03:42.759035 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.759010    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71ccae53-32da-4168-9e7f-db82d33ec2ba" (UID: "71ccae53-32da-4168-9e7f-db82d33ec2ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:42.759117 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.759027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "66eb9624-c463-43e4-891e-7b78dc13bc2f" (UID: "66eb9624-c463-43e4-891e-7b78dc13bc2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:03:42.760681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.760654    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf" (OuterVolumeSpecName: "kube-api-access-6xsbf") pod "66eb9624-c463-43e4-891e-7b78dc13bc2f" (UID: "66eb9624-c463-43e4-891e-7b78dc13bc2f"). InnerVolumeSpecName "kube-api-access-6xsbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:03:42.760799 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.760711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn" (OuterVolumeSpecName: "kube-api-access-kmqkn") pod "71ccae53-32da-4168-9e7f-db82d33ec2ba" (UID: "71ccae53-32da-4168-9e7f-db82d33ec2ba"). InnerVolumeSpecName "kube-api-access-kmqkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:03:42.859540 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.859437    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xsbf\" (UniqueName: \"kubernetes.io/projected/66eb9624-c463-43e4-891e-7b78dc13bc2f-kube-api-access-6xsbf\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:42.859540 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.859474    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmqkn\" (UniqueName: \"kubernetes.io/projected/71ccae53-32da-4168-9e7f-db82d33ec2ba-kube-api-access-kmqkn\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:42.859540 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.859483    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66eb9624-c463-43e4-891e-7b78dc13bc2f-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:42.859540 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:42.859493    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71ccae53-32da-4168-9e7f-db82d33ec2ba-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:03:43.324530 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.324496    2560 generic.go:356] "Generic (PLEG): container finished" podID="71ccae53-32da-4168-9e7f-db82d33ec2ba" containerID="2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0" exitCode=0
Jul 29 03:03:43.324755 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.324563    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"
Jul 29 03:03:43.324755 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.324585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" event={"ID":"71ccae53-32da-4168-9e7f-db82d33ec2ba","Type":"ContainerDied","Data":"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"}
Jul 29 03:03:43.324755 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.324669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr" event={"ID":"71ccae53-32da-4168-9e7f-db82d33ec2ba","Type":"ContainerDied","Data":"c9b86a3a047700d4086d1c48d7e4fbe3d1961cc2847a0b5516149f897fe96373"}
Jul 29 03:03:43.324755 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.324695    2560 scope.go:117] "RemoveContainer" containerID="2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"
Jul 29 03:03:43.326002 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.325978    2560 generic.go:356] "Generic (PLEG): container finished" podID="66eb9624-c463-43e4-891e-7b78dc13bc2f" containerID="ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb" exitCode=0
Jul 29 03:03:43.326102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.326016    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"
Jul 29 03:03:43.326102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.326008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" event={"ID":"66eb9624-c463-43e4-891e-7b78dc13bc2f","Type":"ContainerDied","Data":"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"}
Jul 29 03:03:43.326191 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.326151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh" event={"ID":"66eb9624-c463-43e4-891e-7b78dc13bc2f","Type":"ContainerDied","Data":"dec120687b8d2871065967fb7f084722b18e0f2229b40988dbc4cbdb9223e8ed"}
Jul 29 03:03:43.335094 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.335070    2560 scope.go:117] "RemoveContainer" containerID="2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"
Jul 29 03:03:43.335473 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:03:43.335447    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0\": container with ID starting with 2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0 not found: ID does not exist" containerID="2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"
Jul 29 03:03:43.335662 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.335481    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0"} err="failed to get container status \"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0\": rpc error: code = NotFound desc = could not find container \"2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0\": container with ID starting with 2faafdc743eae6afa6edfcf193aea3b1d0d893d46d3a55481e3431ce1b93d2d0 not found: ID does not exist"
Jul 29 03:03:43.335662 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.335500    2560 scope.go:117] "RemoveContainer" containerID="ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"
Jul 29 03:03:43.346299 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.346266    2560 scope.go:117] "RemoveContainer" containerID="ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"
Jul 29 03:03:43.346687 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:03:43.346668    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb\": container with ID starting with ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb not found: ID does not exist" containerID="ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"
Jul 29 03:03:43.346746 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.346699    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb"} err="failed to get container status \"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb\": rpc error: code = NotFound desc = could not find container \"ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb\": container with ID starting with ebe594f8920d79e5f92de8fd7f88e4f87f51a354660428a9eec8ce6aa2e28cfb not found: ID does not exist"
Jul 29 03:03:43.352536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.352507    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:43.359176 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.359152    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ab95c5e9-6f5d4d8668-r7cnh"]
Jul 29 03:03:43.373149 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.373100    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:43.380543 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:43.380509    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ab95c5e9-855977c58f-8zqtr"]
Jul 29 03:03:44.408428 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:44.408393    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66eb9624-c463-43e4-891e-7b78dc13bc2f" path="/var/lib/kubelet/pods/66eb9624-c463-43e4-891e-7b78dc13bc2f/volumes"
Jul 29 03:03:44.408814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:44.408753    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ccae53-32da-4168-9e7f-db82d33ec2ba" path="/var/lib/kubelet/pods/71ccae53-32da-4168-9e7f-db82d33ec2ba/volumes"
Jul 29 03:03:44.409075 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:44.409060    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad65253c-b210-45e7-90f6-7e855bb0f62e" path="/var/lib/kubelet/pods/ad65253c-b210-45e7-90f6-7e855bb0f62e/volumes"
Jul 29 03:03:46.320567 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320526    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320879    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66eb9624-c463-43e4-891e-7b78dc13bc2f" containerName="payload-pre-processing"
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320891    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66eb9624-c463-43e4-891e-7b78dc13bc2f" containerName="payload-pre-processing"
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320917    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ccae53-32da-4168-9e7f-db82d33ec2ba" containerName="payload-processing"
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320923    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ccae53-32da-4168-9e7f-db82d33ec2ba" containerName="payload-processing"
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320931    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad65253c-b210-45e7-90f6-7e855bb0f62e" containerName="revoke-keys"
Jul 29 03:03:46.320967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320936    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad65253c-b210-45e7-90f6-7e855bb0f62e" containerName="revoke-keys"
Jul 29 03:03:46.321153 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320987    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ccae53-32da-4168-9e7f-db82d33ec2ba" containerName="payload-processing"
Jul 29 03:03:46.321153 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.320996    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad65253c-b210-45e7-90f6-7e855bb0f62e" containerName="revoke-keys"
Jul 29 03:03:46.321153 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.321001    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="66eb9624-c463-43e4-891e-7b78dc13bc2f" containerName="payload-pre-processing"
Jul 29 03:03:46.325752 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.325723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.329925 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.329897    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4a476faa-dockercfg-twplr\""
Jul 29 03:03:46.330149 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.330128    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4a476faa\""
Jul 29 03:03:46.339582 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.339550    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:03:46.343262 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.343222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.347428 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.347396    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:03:46.359644 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.359607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:03:46.389842 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.389801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.390055 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.389854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qsf9\" (UniqueName: \"kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.390055 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.389938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6flg\" (UniqueName: \"kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.390055 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.390031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.491512 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.491475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6flg\" (UniqueName: \"kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.491814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.491555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.491814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.491618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.491814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.491659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qsf9\" (UniqueName: \"kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.492638 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.492616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.492741 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.492664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.501280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.501227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qsf9\" (UniqueName: \"kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9\") pod \"payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") " pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.501402 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.501298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6flg\" (UniqueName: \"kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg\") pod \"payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.638046 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.637933    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:46.655437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.655399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:46.810448 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.810407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:03:46.811056 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:46.810991    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bbcf31_7c3c_4137_b962_0beff6ee5dbf.slice/crio-80f23e1b3e20b4bf8784b920a4322f300944d6898addf2822855422ef9f1b9d7 WatchSource:0}: Error finding container 80f23e1b3e20b4bf8784b920a4322f300944d6898addf2822855422ef9f1b9d7: Status 404 returned error can't find the container with id 80f23e1b3e20b4bf8784b920a4322f300944d6898addf2822855422ef9f1b9d7
Jul 29 03:03:46.848086 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:46.848055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:03:46.860589 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:03:46.860556    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bff94f5_4913_4caa_b2f8_08db529e49eb.slice/crio-64746253c5742ffe2473a37ac951c7c6a0c144574714370961d46293401aaf23 WatchSource:0}: Error finding container 64746253c5742ffe2473a37ac951c7c6a0c144574714370961d46293401aaf23: Status 404 returned error can't find the container with id 64746253c5742ffe2473a37ac951c7c6a0c144574714370961d46293401aaf23
Jul 29 03:03:47.353180 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.353131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" event={"ID":"1bff94f5-4913-4caa-b2f8-08db529e49eb","Type":"ContainerStarted","Data":"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"}
Jul 29 03:03:47.353655 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.353201    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:47.353655 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.353226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" event={"ID":"1bff94f5-4913-4caa-b2f8-08db529e49eb","Type":"ContainerStarted","Data":"64746253c5742ffe2473a37ac951c7c6a0c144574714370961d46293401aaf23"}
Jul 29 03:03:47.354789 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.354755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" event={"ID":"54bbcf31-7c3c-4137-b962-0beff6ee5dbf","Type":"ContainerStarted","Data":"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"}
Jul 29 03:03:47.354904 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.354815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" event={"ID":"54bbcf31-7c3c-4137-b962-0beff6ee5dbf","Type":"ContainerStarted","Data":"80f23e1b3e20b4bf8784b920a4322f300944d6898addf2822855422ef9f1b9d7"}
Jul 29 03:03:47.354904 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.354845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:47.372226 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:47.372169    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" podStartSLOduration=1.372149672 podStartE2EDuration="1.372149672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:03:47.370625731 +0000 UTC m=+1725.405342422" watchObservedRunningTime="2026-07-29 03:03:47.372149672 +0000 UTC m=+1725.406866391"
Jul 29 03:03:58.363749 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:58.363714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:03:58.364266 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:58.363789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:03:58.383674 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:03:58.383610    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" podStartSLOduration=12.383586051 podStartE2EDuration="12.383586051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:03:47.392122345 +0000 UTC m=+1725.426839035" watchObservedRunningTime="2026-07-29 03:03:58.383586051 +0000 UTC m=+1736.418302748"
Jul 29 03:04:11.365858 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.365822    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"]
Jul 29 03:04:11.369353 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.369333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:11.372292 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.372263    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:04:11.372292 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.372268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:04:11.378570 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.378541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"]
Jul 29 03:04:11.528013 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.527971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4a476faa-8z65w\" (UID: \"5fa6c286-c6aa-47cc-8187-8c6ccb66d047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:11.628908 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.628801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4a476faa-8z65w\" (UID: \"5fa6c286-c6aa-47cc-8187-8c6ccb66d047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:11.629571 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.629544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4a476faa-8z65w\" (UID: \"5fa6c286-c6aa-47cc-8187-8c6ccb66d047\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:11.682659 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.682618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:11.826264 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:11.826214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"]
Jul 29 03:04:11.827905 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:04:11.827879    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa6c286_c6aa_47cc_8187_8c6ccb66d047.slice/crio-c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630 WatchSource:0}: Error finding container c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630: Status 404 returned error can't find the container with id c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630
Jul 29 03:04:12.501340 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:12.501302    2560 generic.go:356] "Generic (PLEG): container finished" podID="5fa6c286-c6aa-47cc-8187-8c6ccb66d047" containerID="c27f033c1d69d029229063817e21f2ba13ab16c65bcb32dd20a83840179abefc" exitCode=0
Jul 29 03:04:12.501726 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:12.501395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w" event={"ID":"5fa6c286-c6aa-47cc-8187-8c6ccb66d047","Type":"ContainerDied","Data":"c27f033c1d69d029229063817e21f2ba13ab16c65bcb32dd20a83840179abefc"}
Jul 29 03:04:12.501726 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:12.501456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w" event={"ID":"5fa6c286-c6aa-47cc-8187-8c6ccb66d047","Type":"ContainerStarted","Data":"c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630"}
Jul 29 03:04:13.648148 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:13.648116    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:13.749665 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:13.749618    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca\") pod \"5fa6c286-c6aa-47cc-8187-8c6ccb66d047\" (UID: \"5fa6c286-c6aa-47cc-8187-8c6ccb66d047\") "
Jul 29 03:04:13.750014 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:13.749986    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fa6c286-c6aa-47cc-8187-8c6ccb66d047" (UID: "5fa6c286-c6aa-47cc-8187-8c6ccb66d047"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:13.851135 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:13.851024    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6c286-c6aa-47cc-8187-8c6ccb66d047-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:14.515171 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:14.515138    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"
Jul 29 03:04:14.515171 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:14.515162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w" event={"ID":"5fa6c286-c6aa-47cc-8187-8c6ccb66d047","Type":"ContainerDied","Data":"c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630"}
Jul 29 03:04:14.515436 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:14.515212    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9de002446910cc8b8fb457ae0d2cf3ebce4b509d8c4b9494ae36095ef791630"
Jul 29 03:04:16.423093 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.423055    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:04:16.423645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.423395    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" podUID="1bff94f5-4913-4caa-b2f8-08db529e49eb" containerName="payload-processing" containerID="cri-o://0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe" gracePeriod=30
Jul 29 03:04:16.434261 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.434131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:04:16.434741 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.434708    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" podUID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" containerName="payload-pre-processing" containerID="cri-o://96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7" gracePeriod=30
Jul 29 03:04:16.577725 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.577673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"]
Jul 29 03:04:16.580343 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.580291    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4a476faa-8z65w"]
Jul 29 03:04:16.723487 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.723457    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:04:16.726728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.726702    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:04:16.880541 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880497    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume\") pod \"1bff94f5-4913-4caa-b2f8-08db529e49eb\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") "
Jul 29 03:04:16.880787 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880580    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume\") pod \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") "
Jul 29 03:04:16.880787 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880610    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qsf9\" (UniqueName: \"kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9\") pod \"1bff94f5-4913-4caa-b2f8-08db529e49eb\" (UID: \"1bff94f5-4913-4caa-b2f8-08db529e49eb\") "
Jul 29 03:04:16.880787 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880644    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6flg\" (UniqueName: \"kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg\") pod \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\" (UID: \"54bbcf31-7c3c-4137-b962-0beff6ee5dbf\") "
Jul 29 03:04:16.880967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54bbcf31-7c3c-4137-b962-0beff6ee5dbf" (UID: "54bbcf31-7c3c-4137-b962-0beff6ee5dbf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:16.881032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.880967    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bff94f5-4913-4caa-b2f8-08db529e49eb" (UID: "1bff94f5-4913-4caa-b2f8-08db529e49eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:16.882856 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.882834    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg" (OuterVolumeSpecName: "kube-api-access-m6flg") pod "54bbcf31-7c3c-4137-b962-0beff6ee5dbf" (UID: "54bbcf31-7c3c-4137-b962-0beff6ee5dbf"). InnerVolumeSpecName "kube-api-access-m6flg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:04:16.882929 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.882840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9" (OuterVolumeSpecName: "kube-api-access-6qsf9") pod "1bff94f5-4913-4caa-b2f8-08db529e49eb" (UID: "1bff94f5-4913-4caa-b2f8-08db529e49eb"). InnerVolumeSpecName "kube-api-access-6qsf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:04:16.981579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.981485    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bff94f5-4913-4caa-b2f8-08db529e49eb-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:16.981579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.981518    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:16.981579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.981530    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qsf9\" (UniqueName: \"kubernetes.io/projected/1bff94f5-4913-4caa-b2f8-08db529e49eb-kube-api-access-6qsf9\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:16.981579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:16.981539    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6flg\" (UniqueName: \"kubernetes.io/projected/54bbcf31-7c3c-4137-b962-0beff6ee5dbf-kube-api-access-m6flg\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:17.535311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.535272    2560 generic.go:356] "Generic (PLEG): container finished" podID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" containerID="96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7" exitCode=0
Jul 29 03:04:17.535311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.535317    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"
Jul 29 03:04:17.535795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.535340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" event={"ID":"54bbcf31-7c3c-4137-b962-0beff6ee5dbf","Type":"ContainerDied","Data":"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"}
Jul 29 03:04:17.535795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.535401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2" event={"ID":"54bbcf31-7c3c-4137-b962-0beff6ee5dbf","Type":"ContainerDied","Data":"80f23e1b3e20b4bf8784b920a4322f300944d6898addf2822855422ef9f1b9d7"}
Jul 29 03:04:17.535795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.535426    2560 scope.go:117] "RemoveContainer" containerID="96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"
Jul 29 03:04:17.536933 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.536904    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bff94f5-4913-4caa-b2f8-08db529e49eb" containerID="0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe" exitCode=0
Jul 29 03:04:17.537028 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.536952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" event={"ID":"1bff94f5-4913-4caa-b2f8-08db529e49eb","Type":"ContainerDied","Data":"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"}
Jul 29 03:04:17.537028 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.536982    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"
Jul 29 03:04:17.537128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.537057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c" event={"ID":"1bff94f5-4913-4caa-b2f8-08db529e49eb","Type":"ContainerDied","Data":"64746253c5742ffe2473a37ac951c7c6a0c144574714370961d46293401aaf23"}
Jul 29 03:04:17.547275 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.547198    2560 scope.go:117] "RemoveContainer" containerID="96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"
Jul 29 03:04:17.547672 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:04:17.547648    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7\": container with ID starting with 96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7 not found: ID does not exist" containerID="96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"
Jul 29 03:04:17.547760 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.547681    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7"} err="failed to get container status \"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7\": rpc error: code = NotFound desc = could not find container \"96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7\": container with ID starting with 96520d44a483ac51cf97dc4d7ef473c8fff0bc2036e9fc6f75a5c4cbb0def9a7 not found: ID does not exist"
Jul 29 03:04:17.547760 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.547704    2560 scope.go:117] "RemoveContainer" containerID="0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"
Jul 29 03:04:17.557326 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.557296    2560 scope.go:117] "RemoveContainer" containerID="0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"
Jul 29 03:04:17.557738 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:04:17.557712    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe\": container with ID starting with 0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe not found: ID does not exist" containerID="0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"
Jul 29 03:04:17.557835 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.557754    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe"} err="failed to get container status \"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe\": rpc error: code = NotFound desc = could not find container \"0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe\": container with ID starting with 0d6261240c5990c1ffb63509fe29ff90a85e54128e7c9f63e3ba10b804723cbe not found: ID does not exist"
Jul 29 03:04:17.561686 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.561649    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:04:17.566333 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.566290    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4a476faa-65b9d64c5b-q98x2"]
Jul 29 03:04:17.578412 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.578370    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:04:17.582615 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:17.582583    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4a476faa-86cf879db8-6p82c"]
Jul 29 03:04:18.408227 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:18.408188    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bff94f5-4913-4caa-b2f8-08db529e49eb" path="/var/lib/kubelet/pods/1bff94f5-4913-4caa-b2f8-08db529e49eb/volumes"
Jul 29 03:04:18.408606 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:18.408591    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" path="/var/lib/kubelet/pods/54bbcf31-7c3c-4137-b962-0beff6ee5dbf/volumes"
Jul 29 03:04:18.408888 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:18.408874    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa6c286-c6aa-47cc-8187-8c6ccb66d047" path="/var/lib/kubelet/pods/5fa6c286-c6aa-47cc-8187-8c6ccb66d047/volumes"
Jul 29 03:04:21.460578 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460534    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:21.460955 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460916    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa6c286-c6aa-47cc-8187-8c6ccb66d047" containerName="revoke-keys"
Jul 29 03:04:21.460955 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460928    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa6c286-c6aa-47cc-8187-8c6ccb66d047" containerName="revoke-keys"
Jul 29 03:04:21.460955 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460945    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" containerName="payload-pre-processing"
Jul 29 03:04:21.460955 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460951    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" containerName="payload-pre-processing"
Jul 29 03:04:21.461102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460964    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bff94f5-4913-4caa-b2f8-08db529e49eb" containerName="payload-processing"
Jul 29 03:04:21.461102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.460970    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bff94f5-4913-4caa-b2f8-08db529e49eb" containerName="payload-processing"
Jul 29 03:04:21.461102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.461022    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa6c286-c6aa-47cc-8187-8c6ccb66d047" containerName="revoke-keys"
Jul 29 03:04:21.461102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.461030    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bff94f5-4913-4caa-b2f8-08db529e49eb" containerName="payload-processing"
Jul 29 03:04:21.461102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.461040    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="54bbcf31-7c3c-4137-b962-0beff6ee5dbf" containerName="payload-pre-processing"
Jul 29 03:04:21.465486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.465456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.470727 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.470703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-92d01eb1\""
Jul 29 03:04:21.484707 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.484668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:21.520120 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.520077    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:21.523690 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.523664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.523860 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.523830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqddf\" (UniqueName: \"kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.523921 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.523878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.528097 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.528068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-92d01eb1-dockercfg-5jmgj\""
Jul 29 03:04:21.543865 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.543825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:21.624719 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.624680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86snv\" (UniqueName: \"kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.624950 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.624736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqddf\" (UniqueName: \"kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.624950 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.624765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.624950 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.624783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.625573 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.625550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.638520 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.638492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqddf\" (UniqueName: \"kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf\") pod \"payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.725701 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.725588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.725880 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.725714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86snv\" (UniqueName: \"kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.726429 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.726407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.734293 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.734236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86snv\" (UniqueName: \"kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv\") pod \"payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") " pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.776895 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.776851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:21.834889 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.834846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:21.935267 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:21.935217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:21.937777 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:04:21.937745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb143981c_39f0_419b_b09e_84adfdf91dcd.slice/crio-0ca4a8ee0b9b6bdb56b40540456aa6adaf80076251e2028002b38f9f756165c9 WatchSource:0}: Error finding container 0ca4a8ee0b9b6bdb56b40540456aa6adaf80076251e2028002b38f9f756165c9: Status 404 returned error can't find the container with id 0ca4a8ee0b9b6bdb56b40540456aa6adaf80076251e2028002b38f9f756165c9
Jul 29 03:04:22.000188 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.000152    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:22.002499 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:04:22.002478    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962d3b59_7a21_4160_b0c4_0dde278e92b3.slice/crio-33ba08ca07ed70edda01c3f8ce3826aa3b0c54bd46c3fd86ee6dcae660fb99d1 WatchSource:0}: Error finding container 33ba08ca07ed70edda01c3f8ce3826aa3b0c54bd46c3fd86ee6dcae660fb99d1: Status 404 returned error can't find the container with id 33ba08ca07ed70edda01c3f8ce3826aa3b0c54bd46c3fd86ee6dcae660fb99d1
Jul 29 03:04:22.571858 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.571817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" event={"ID":"962d3b59-7a21-4160-b0c4-0dde278e92b3","Type":"ContainerStarted","Data":"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"}
Jul 29 03:04:22.572321 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.571882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" event={"ID":"962d3b59-7a21-4160-b0c4-0dde278e92b3","Type":"ContainerStarted","Data":"33ba08ca07ed70edda01c3f8ce3826aa3b0c54bd46c3fd86ee6dcae660fb99d1"}
Jul 29 03:04:22.572321 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.572016    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:22.573639 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.573611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" event={"ID":"b143981c-39f0-419b-b09e-84adfdf91dcd","Type":"ContainerStarted","Data":"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"}
Jul 29 03:04:22.573767 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.573652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" event={"ID":"b143981c-39f0-419b-b09e-84adfdf91dcd","Type":"ContainerStarted","Data":"0ca4a8ee0b9b6bdb56b40540456aa6adaf80076251e2028002b38f9f756165c9"}
Jul 29 03:04:22.573767 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.573692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:22.593409 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.593357    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" podStartSLOduration=1.593339098 podStartE2EDuration="1.593339098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:04:22.591669204 +0000 UTC m=+1760.626385895" watchObservedRunningTime="2026-07-29 03:04:22.593339098 +0000 UTC m=+1760.628055765"
Jul 29 03:04:22.612032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:22.611973    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" podStartSLOduration=1.6119520920000001 podStartE2EDuration="1.611952092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:04:22.609884018 +0000 UTC m=+1760.644600712" watchObservedRunningTime="2026-07-29 03:04:22.611952092 +0000 UTC m=+1760.646668790"
Jul 29 03:04:33.582719 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:33.582686    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:33.583124 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:33.582765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:45.580580 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.580536    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"]
Jul 29 03:04:45.583867 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.583843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:45.586737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.586706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:04:45.586894 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.586713    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:04:45.592294 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.592207    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"]
Jul 29 03:04:45.622217 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.622179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg\" (UID: \"75dc321d-dfc6-497a-bcdf-14e0e2be792a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:45.723162 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.723094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg\" (UID: \"75dc321d-dfc6-497a-bcdf-14e0e2be792a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:45.723915 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.723891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg\" (UID: \"75dc321d-dfc6-497a-bcdf-14e0e2be792a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:45.897798 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:45.897704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:46.038722 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:46.038688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"]
Jul 29 03:04:46.040483 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:04:46.040453    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dc321d_dfc6_497a_bcdf_14e0e2be792a.slice/crio-10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3 WatchSource:0}: Error finding container 10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3: Status 404 returned error can't find the container with id 10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3
Jul 29 03:04:46.722224 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:46.722178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg" event={"ID":"75dc321d-dfc6-497a-bcdf-14e0e2be792a","Type":"ContainerStarted","Data":"c9865c2ff8209177a6b463c89938cba40697e9a08f122c311cd1f44e6834739b"}
Jul 29 03:04:46.722707 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:46.722330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg" event={"ID":"75dc321d-dfc6-497a-bcdf-14e0e2be792a","Type":"ContainerStarted","Data":"10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3"}
Jul 29 03:04:46.738100 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:46.738039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg" podStartSLOduration=1.73802021 podStartE2EDuration="1.73802021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:04:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:04:46.737347974 +0000 UTC m=+1784.772064683" watchObservedRunningTime="2026-07-29 03:04:46.73802021 +0000 UTC m=+1784.772736899"
Jul 29 03:04:47.729821 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:47.729788    2560 generic.go:356] "Generic (PLEG): container finished" podID="75dc321d-dfc6-497a-bcdf-14e0e2be792a" containerID="c9865c2ff8209177a6b463c89938cba40697e9a08f122c311cd1f44e6834739b" exitCode=0
Jul 29 03:04:47.730236 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:47.729847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg" event={"ID":"75dc321d-dfc6-497a-bcdf-14e0e2be792a","Type":"ContainerDied","Data":"c9865c2ff8209177a6b463c89938cba40697e9a08f122c311cd1f44e6834739b"}
Jul 29 03:04:48.882780 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:48.882751    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:48.952436 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:48.952397    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca\") pod \"75dc321d-dfc6-497a-bcdf-14e0e2be792a\" (UID: \"75dc321d-dfc6-497a-bcdf-14e0e2be792a\") "
Jul 29 03:04:48.952785 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:48.952760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75dc321d-dfc6-497a-bcdf-14e0e2be792a" (UID: "75dc321d-dfc6-497a-bcdf-14e0e2be792a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:49.053113 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:49.053012    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75dc321d-dfc6-497a-bcdf-14e0e2be792a-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:49.742620 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:49.742589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"
Jul 29 03:04:49.742620 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:49.742605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg" event={"ID":"75dc321d-dfc6-497a-bcdf-14e0e2be792a","Type":"ContainerDied","Data":"10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3"}
Jul 29 03:04:49.742855 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:49.742655    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10b3647b3b6be368126417e024bd081cb7d185d82efc63ec00f385f1c2a412f3"
Jul 29 03:04:51.386535 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.386493    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:51.387115 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.386745    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" podUID="962d3b59-7a21-4160-b0c4-0dde278e92b3" containerName="payload-processing" containerID="cri-o://8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf" gracePeriod=30
Jul 29 03:04:51.394835 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.394789    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:51.395102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.395070    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" podUID="b143981c-39f0-419b-b09e-84adfdf91dcd" containerName="payload-pre-processing" containerID="cri-o://0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc" gracePeriod=30
Jul 29 03:04:51.530149 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.530108    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"]
Jul 29 03:04:51.532511 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.532482    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-92d01eb1-lldbg"]
Jul 29 03:04:51.678521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.678493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:51.701046 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.701016    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:51.756202 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.756165    2560 generic.go:356] "Generic (PLEG): container finished" podID="b143981c-39f0-419b-b09e-84adfdf91dcd" containerID="0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc" exitCode=0
Jul 29 03:04:51.756456 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.756218    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"
Jul 29 03:04:51.756456 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.756285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" event={"ID":"b143981c-39f0-419b-b09e-84adfdf91dcd","Type":"ContainerDied","Data":"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"}
Jul 29 03:04:51.756456 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.756356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq" event={"ID":"b143981c-39f0-419b-b09e-84adfdf91dcd","Type":"ContainerDied","Data":"0ca4a8ee0b9b6bdb56b40540456aa6adaf80076251e2028002b38f9f756165c9"}
Jul 29 03:04:51.756456 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.756391    2560 scope.go:117] "RemoveContainer" containerID="0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"
Jul 29 03:04:51.757966 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.757939    2560 generic.go:356] "Generic (PLEG): container finished" podID="962d3b59-7a21-4160-b0c4-0dde278e92b3" containerID="8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf" exitCode=0
Jul 29 03:04:51.758108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.757999    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"
Jul 29 03:04:51.758108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.758024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" event={"ID":"962d3b59-7a21-4160-b0c4-0dde278e92b3","Type":"ContainerDied","Data":"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"}
Jul 29 03:04:51.758194 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.758089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw" event={"ID":"962d3b59-7a21-4160-b0c4-0dde278e92b3","Type":"ContainerDied","Data":"33ba08ca07ed70edda01c3f8ce3826aa3b0c54bd46c3fd86ee6dcae660fb99d1"}
Jul 29 03:04:51.768437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.768409    2560 scope.go:117] "RemoveContainer" containerID="0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"
Jul 29 03:04:51.768812 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:04:51.768785    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc\": container with ID starting with 0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc not found: ID does not exist" containerID="0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"
Jul 29 03:04:51.768883 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.768828    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc"} err="failed to get container status \"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc\": rpc error: code = NotFound desc = could not find container \"0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc\": container with ID starting with 0288bb2f6d72b69fa09cebbcb26e926e819d30b0b3616eb25e4c7e246e6320cc not found: ID does not exist"
Jul 29 03:04:51.768883 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.768857    2560 scope.go:117] "RemoveContainer" containerID="8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"
Jul 29 03:04:51.778328 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778291    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume\") pod \"962d3b59-7a21-4160-b0c4-0dde278e92b3\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") "
Jul 29 03:04:51.778328 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86snv\" (UniqueName: \"kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv\") pod \"962d3b59-7a21-4160-b0c4-0dde278e92b3\" (UID: \"962d3b59-7a21-4160-b0c4-0dde278e92b3\") "
Jul 29 03:04:51.778602 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume\") pod \"b143981c-39f0-419b-b09e-84adfdf91dcd\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") "
Jul 29 03:04:51.778602 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqddf\" (UniqueName: \"kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf\") pod \"b143981c-39f0-419b-b09e-84adfdf91dcd\" (UID: \"b143981c-39f0-419b-b09e-84adfdf91dcd\") "
Jul 29 03:04:51.778705 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "962d3b59-7a21-4160-b0c4-0dde278e92b3" (UID: "962d3b59-7a21-4160-b0c4-0dde278e92b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:51.778795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778776    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962d3b59-7a21-4160-b0c4-0dde278e92b3-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:51.778858 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.778839    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b143981c-39f0-419b-b09e-84adfdf91dcd" (UID: "b143981c-39f0-419b-b09e-84adfdf91dcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:04:51.779222 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.779193    2560 scope.go:117] "RemoveContainer" containerID="8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"
Jul 29 03:04:51.779580 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:04:51.779553    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf\": container with ID starting with 8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf not found: ID does not exist" containerID="8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"
Jul 29 03:04:51.779645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.779590    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf"} err="failed to get container status \"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf\": rpc error: code = NotFound desc = could not find container \"8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf\": container with ID starting with 8771a9c2bb9db5b453bd0353c194572b13cf635539414153060eff8235574fdf not found: ID does not exist"
Jul 29 03:04:51.780762 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.780734    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv" (OuterVolumeSpecName: "kube-api-access-86snv") pod "962d3b59-7a21-4160-b0c4-0dde278e92b3" (UID: "962d3b59-7a21-4160-b0c4-0dde278e92b3"). InnerVolumeSpecName "kube-api-access-86snv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:04:51.780873 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.780819    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf" (OuterVolumeSpecName: "kube-api-access-vqddf") pod "b143981c-39f0-419b-b09e-84adfdf91dcd" (UID: "b143981c-39f0-419b-b09e-84adfdf91dcd"). InnerVolumeSpecName "kube-api-access-vqddf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:04:51.880311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.880236    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqddf\" (UniqueName: \"kubernetes.io/projected/b143981c-39f0-419b-b09e-84adfdf91dcd-kube-api-access-vqddf\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:51.880311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.880301    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86snv\" (UniqueName: \"kubernetes.io/projected/962d3b59-7a21-4160-b0c4-0dde278e92b3-kube-api-access-86snv\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:51.880311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:51.880314    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b143981c-39f0-419b-b09e-84adfdf91dcd-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:04:52.082961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.082913    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:52.087303 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.087269    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-92d01eb1-b64bfd678-8hdhw"]
Jul 29 03:04:52.098136 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.098102    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:52.101688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.101661    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-92d01eb1-76c46b6d9b-f5mzq"]
Jul 29 03:04:52.408778 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.408743    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75dc321d-dfc6-497a-bcdf-14e0e2be792a" path="/var/lib/kubelet/pods/75dc321d-dfc6-497a-bcdf-14e0e2be792a/volumes"
Jul 29 03:04:52.409327 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.409305    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="962d3b59-7a21-4160-b0c4-0dde278e92b3" path="/var/lib/kubelet/pods/962d3b59-7a21-4160-b0c4-0dde278e92b3/volumes"
Jul 29 03:04:52.409709 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:04:52.409691    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b143981c-39f0-419b-b09e-84adfdf91dcd" path="/var/lib/kubelet/pods/b143981c-39f0-419b-b09e-84adfdf91dcd/volumes"
Jul 29 03:05:02.649404 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:05:02.649370    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:05:02.654296 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:05:02.654265    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:06:46.490681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.490581    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491089    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75dc321d-dfc6-497a-bcdf-14e0e2be792a" containerName="revoke-keys"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491108    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="75dc321d-dfc6-497a-bcdf-14e0e2be792a" containerName="revoke-keys"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491141    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b143981c-39f0-419b-b09e-84adfdf91dcd" containerName="payload-pre-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491151    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b143981c-39f0-419b-b09e-84adfdf91dcd" containerName="payload-pre-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491173    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962d3b59-7a21-4160-b0c4-0dde278e92b3" containerName="payload-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491181    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="962d3b59-7a21-4160-b0c4-0dde278e92b3" containerName="payload-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491305    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="962d3b59-7a21-4160-b0c4-0dde278e92b3" containerName="payload-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491320    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b143981c-39f0-419b-b09e-84adfdf91dcd" containerName="payload-pre-processing"
Jul 29 03:06:46.491329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.491329    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="75dc321d-dfc6-497a-bcdf-14e0e2be792a" containerName="revoke-keys"
Jul 29 03:06:46.494474 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.494454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.498824 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.498805    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3b7bc34b\""
Jul 29 03:06:46.499169 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.499154    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3b7bc34b-dockercfg-x8tkh\""
Jul 29 03:06:46.510678 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.510647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:06:46.594658 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.594619    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:06:46.598374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.598352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.627397 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.627359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:06:46.651971 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.651928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2ljr\" (UniqueName: \"kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.652195 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.651989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.752946 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.752846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2ljr\" (UniqueName: \"kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.752946 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.752922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.753157 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.752967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.753157 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.753027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrcz\" (UniqueName: \"kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.753711 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.753693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.764396 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.764374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2ljr\" (UniqueName: \"kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr\") pod \"payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.804596 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.804557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:46.853794 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.853751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.853988 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.853817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrcz\" (UniqueName: \"kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.854550 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.854528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.865669 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.865637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrcz\" (UniqueName: \"kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz\") pod \"payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") " pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.909521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.909482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:46.967511 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:46.967480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:06:46.969082 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:06:46.969048    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed43749_55e1_4b98_af8b_605d775e4d3e.slice/crio-7f8108222f20b5daaa91a9a8afbbf67cdcb06ce125416d9d6d0c27919f977eb3 WatchSource:0}: Error finding container 7f8108222f20b5daaa91a9a8afbbf67cdcb06ce125416d9d6d0c27919f977eb3: Status 404 returned error can't find the container with id 7f8108222f20b5daaa91a9a8afbbf67cdcb06ce125416d9d6d0c27919f977eb3
Jul 29 03:06:47.087935 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:06:47.087904    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349e676e_d343_4796_9987_ebd421f62408.slice/crio-8162fb9dfb15f377c3023e19db442550dd89b605f6c9492831f9e183cf9d0aca WatchSource:0}: Error finding container 8162fb9dfb15f377c3023e19db442550dd89b605f6c9492831f9e183cf9d0aca: Status 404 returned error can't find the container with id 8162fb9dfb15f377c3023e19db442550dd89b605f6c9492831f9e183cf9d0aca
Jul 29 03:06:47.088092 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.087952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:06:47.415482 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.415367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" event={"ID":"3ed43749-55e1-4b98-af8b-605d775e4d3e","Type":"ContainerStarted","Data":"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"}
Jul 29 03:06:47.415482 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.415429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" event={"ID":"3ed43749-55e1-4b98-af8b-605d775e4d3e","Type":"ContainerStarted","Data":"7f8108222f20b5daaa91a9a8afbbf67cdcb06ce125416d9d6d0c27919f977eb3"}
Jul 29 03:06:47.415736 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.415571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:06:47.421382 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.421346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" event={"ID":"349e676e-d343-4796-9987-ebd421f62408","Type":"ContainerStarted","Data":"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"}
Jul 29 03:06:47.421579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.421404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" event={"ID":"349e676e-d343-4796-9987-ebd421f62408","Type":"ContainerStarted","Data":"8162fb9dfb15f377c3023e19db442550dd89b605f6c9492831f9e183cf9d0aca"}
Jul 29 03:06:47.421579 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.421476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:47.453943 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.453876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" podStartSLOduration=1.453856022 podStartE2EDuration="1.453856022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:06:47.441397575 +0000 UTC m=+1905.476114280" watchObservedRunningTime="2026-07-29 03:06:47.453856022 +0000 UTC m=+1905.488572727"
Jul 29 03:06:47.478181 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:47.478117    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" podStartSLOduration=1.478099818 podStartE2EDuration="1.478099818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:06:47.474545802 +0000 UTC m=+1905.509262494" watchObservedRunningTime="2026-07-29 03:06:47.478099818 +0000 UTC m=+1905.512816508"
Jul 29 03:06:58.429427 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:58.429391    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:06:58.429821 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:06:58.429468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:07:17.734539 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.734498    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"]
Jul 29 03:07:17.737926 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.737905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:17.740789 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.740756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:07:17.740874 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.740817    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:07:17.746791 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.746481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"]
Jul 29 03:07:17.844139 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.844096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj\" (UID: \"a5bd07af-7104-4b17-a8dc-e04cc692aece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:17.945081 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.945036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj\" (UID: \"a5bd07af-7104-4b17-a8dc-e04cc692aece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:17.945705 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:17.945682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj\" (UID: \"a5bd07af-7104-4b17-a8dc-e04cc692aece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:18.051040 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:18.050946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:18.190022 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:18.189997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"]
Jul 29 03:07:18.191522 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:07:18.191492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bd07af_7104_4b17_a8dc_e04cc692aece.slice/crio-ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d WatchSource:0}: Error finding container ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d: Status 404 returned error can't find the container with id ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d
Jul 29 03:07:18.604879 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:18.604841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj" event={"ID":"a5bd07af-7104-4b17-a8dc-e04cc692aece","Type":"ContainerStarted","Data":"35f817ced8fe36e51eda8324f0d38f4fd3e0138a3b89a6ccb111205385d6e33b"}
Jul 29 03:07:18.605063 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:18.604898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj" event={"ID":"a5bd07af-7104-4b17-a8dc-e04cc692aece","Type":"ContainerStarted","Data":"ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d"}
Jul 29 03:07:18.623925 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:18.623861    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj" podStartSLOduration=1.623840803 podStartE2EDuration="1.623840803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:07:18.620990497 +0000 UTC m=+1936.655707186" watchObservedRunningTime="2026-07-29 03:07:18.623840803 +0000 UTC m=+1936.658557494"
Jul 29 03:07:19.612658 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:19.612623    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5bd07af-7104-4b17-a8dc-e04cc692aece" containerID="35f817ced8fe36e51eda8324f0d38f4fd3e0138a3b89a6ccb111205385d6e33b" exitCode=0
Jul 29 03:07:19.613059 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:19.612714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj" event={"ID":"a5bd07af-7104-4b17-a8dc-e04cc692aece","Type":"ContainerDied","Data":"35f817ced8fe36e51eda8324f0d38f4fd3e0138a3b89a6ccb111205385d6e33b"}
Jul 29 03:07:20.769818 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:20.769785    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:20.873281 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:20.873149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca\") pod \"a5bd07af-7104-4b17-a8dc-e04cc692aece\" (UID: \"a5bd07af-7104-4b17-a8dc-e04cc692aece\") "
Jul 29 03:07:20.873536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:20.873514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5bd07af-7104-4b17-a8dc-e04cc692aece" (UID: "a5bd07af-7104-4b17-a8dc-e04cc692aece"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:07:20.974646 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:20.974598    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5bd07af-7104-4b17-a8dc-e04cc692aece-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:07:21.626763 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:21.626735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"
Jul 29 03:07:21.626947 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:21.626736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj" event={"ID":"a5bd07af-7104-4b17-a8dc-e04cc692aece","Type":"ContainerDied","Data":"ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d"}
Jul 29 03:07:21.626947 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:21.626857    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff7e7d7957633c88f1464ad34dd1ab50d82e51f46f4c7e57cb3857f31d08928d"
Jul 29 03:07:28.250130 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.250090    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:07:28.250613 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.250430    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" podUID="349e676e-d343-4796-9987-ebd421f62408" containerName="payload-processing" containerID="cri-o://94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966" gracePeriod=30
Jul 29 03:07:28.256925 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.256897    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:07:28.257116 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.257095    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerName="payload-pre-processing" containerID="cri-o://b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef" gracePeriod=30
Jul 29 03:07:28.317141 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:07:28.317102    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed43749_55e1_4b98_af8b_605d775e4d3e.slice/crio-b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 03:07:28.428583 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.428224    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.54:9004: connect: connection refused"
Jul 29 03:07:28.442658 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.442608    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"]
Jul 29 03:07:28.447692 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.447655    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b7bc34b-bdlsj"]
Jul 29 03:07:28.536474 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.536447    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:07:28.539391 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.539366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:07:28.543858 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.543831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvrcz\" (UniqueName: \"kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz\") pod \"349e676e-d343-4796-9987-ebd421f62408\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") "
Jul 29 03:07:28.543964 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.543907    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2ljr\" (UniqueName: \"kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr\") pod \"3ed43749-55e1-4b98-af8b-605d775e4d3e\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") "
Jul 29 03:07:28.543964 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.543948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume\") pod \"349e676e-d343-4796-9987-ebd421f62408\" (UID: \"349e676e-d343-4796-9987-ebd421f62408\") "
Jul 29 03:07:28.544043 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.543980    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume\") pod \"3ed43749-55e1-4b98-af8b-605d775e4d3e\" (UID: \"3ed43749-55e1-4b98-af8b-605d775e4d3e\") "
Jul 29 03:07:28.544381 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.544352    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "349e676e-d343-4796-9987-ebd421f62408" (UID: "349e676e-d343-4796-9987-ebd421f62408"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:07:28.544495 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.544437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ed43749-55e1-4b98-af8b-605d775e4d3e" (UID: "3ed43749-55e1-4b98-af8b-605d775e4d3e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:07:28.546071 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.546044    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz" (OuterVolumeSpecName: "kube-api-access-lvrcz") pod "349e676e-d343-4796-9987-ebd421f62408" (UID: "349e676e-d343-4796-9987-ebd421f62408"). InnerVolumeSpecName "kube-api-access-lvrcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:07:28.546159 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.546090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr" (OuterVolumeSpecName: "kube-api-access-t2ljr") pod "3ed43749-55e1-4b98-af8b-605d775e4d3e" (UID: "3ed43749-55e1-4b98-af8b-605d775e4d3e"). InnerVolumeSpecName "kube-api-access-t2ljr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:07:28.644749 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.644705    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvrcz\" (UniqueName: \"kubernetes.io/projected/349e676e-d343-4796-9987-ebd421f62408-kube-api-access-lvrcz\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:07:28.644749 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.644743    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2ljr\" (UniqueName: \"kubernetes.io/projected/3ed43749-55e1-4b98-af8b-605d775e4d3e-kube-api-access-t2ljr\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:07:28.644749 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.644754    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/349e676e-d343-4796-9987-ebd421f62408-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:07:28.645008 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.644763    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed43749-55e1-4b98-af8b-605d775e4d3e-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:07:28.672211 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.672174    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerID="b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef" exitCode=0
Jul 29 03:07:28.672375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.672224    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"
Jul 29 03:07:28.672375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.672287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" event={"ID":"3ed43749-55e1-4b98-af8b-605d775e4d3e","Type":"ContainerDied","Data":"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"}
Jul 29 03:07:28.672375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.672357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn" event={"ID":"3ed43749-55e1-4b98-af8b-605d775e4d3e","Type":"ContainerDied","Data":"7f8108222f20b5daaa91a9a8afbbf67cdcb06ce125416d9d6d0c27919f977eb3"}
Jul 29 03:07:28.672561 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.672390    2560 scope.go:117] "RemoveContainer" containerID="b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"
Jul 29 03:07:28.673739 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.673714    2560 generic.go:356] "Generic (PLEG): container finished" podID="349e676e-d343-4796-9987-ebd421f62408" containerID="94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966" exitCode=0
Jul 29 03:07:28.673812 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.673765    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"
Jul 29 03:07:28.673850 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.673805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" event={"ID":"349e676e-d343-4796-9987-ebd421f62408","Type":"ContainerDied","Data":"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"}
Jul 29 03:07:28.673936 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.673869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" event={"ID":"349e676e-d343-4796-9987-ebd421f62408","Type":"ContainerDied","Data":"8162fb9dfb15f377c3023e19db442550dd89b605f6c9492831f9e183cf9d0aca"}
Jul 29 03:07:28.682512 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.682492    2560 scope.go:117] "RemoveContainer" containerID="b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"
Jul 29 03:07:28.682827 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:07:28.682807    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef\": container with ID starting with b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef not found: ID does not exist" containerID="b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"
Jul 29 03:07:28.682906 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.682839    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef"} err="failed to get container status \"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef\": rpc error: code = NotFound desc = could not find container \"b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef\": container with ID starting with b873d449782a78cc7d9a914c8f9624df8891c47cc16f81f66b7daef5582781ef not found: ID does not exist"
Jul 29 03:07:28.682906 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.682857    2560 scope.go:117] "RemoveContainer" containerID="94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"
Jul 29 03:07:28.692199 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.692177    2560 scope.go:117] "RemoveContainer" containerID="94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"
Jul 29 03:07:28.692564 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:07:28.692542    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966\": container with ID starting with 94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966 not found: ID does not exist" containerID="94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"
Jul 29 03:07:28.692619 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.692573    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966"} err="failed to get container status \"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966\": rpc error: code = NotFound desc = could not find container \"94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966\": container with ID starting with 94422824a626047d2e66133c3bfc1105da232e0b39a9ad597111e2822b9e1966 not found: ID does not exist"
Jul 29 03:07:28.700117 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.700086    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:07:28.704777 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.704750    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3b7bc34b-64bc7c5fc6-rkmxn"]
Jul 29 03:07:28.721887 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.721854    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:07:28.726578 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:28.726546    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6"]
Jul 29 03:07:29.428637 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:29.428580    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-3b7bc34b-667b465f86-pg6v6" podUID="349e676e-d343-4796-9987-ebd421f62408" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: i/o timeout"
Jul 29 03:07:30.408851 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:30.408813    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349e676e-d343-4796-9987-ebd421f62408" path="/var/lib/kubelet/pods/349e676e-d343-4796-9987-ebd421f62408/volumes"
Jul 29 03:07:30.409200 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:30.409187    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" path="/var/lib/kubelet/pods/3ed43749-55e1-4b98-af8b-605d775e4d3e/volumes"
Jul 29 03:07:30.409526 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:30.409512    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5bd07af-7104-4b17-a8dc-e04cc692aece" path="/var/lib/kubelet/pods/a5bd07af-7104-4b17-a8dc-e04cc692aece/volumes"
Jul 29 03:07:58.161514 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161429    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161763    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349e676e-d343-4796-9987-ebd421f62408" containerName="payload-processing"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161774    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="349e676e-d343-4796-9987-ebd421f62408" containerName="payload-processing"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161792    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerName="payload-pre-processing"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161797    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerName="payload-pre-processing"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161809    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bd07af-7104-4b17-a8dc-e04cc692aece" containerName="revoke-keys"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161815    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bd07af-7104-4b17-a8dc-e04cc692aece" containerName="revoke-keys"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161873    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bd07af-7104-4b17-a8dc-e04cc692aece" containerName="revoke-keys"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="349e676e-d343-4796-9987-ebd421f62408" containerName="payload-processing"
Jul 29 03:07:58.161938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.161888    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed43749-55e1-4b98-af8b-605d775e4d3e" containerName="payload-pre-processing"
Jul 29 03:07:58.164950 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.164931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.168795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.168771    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c659b417-dockercfg-n6zzg\""
Jul 29 03:07:58.169010 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.168993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c659b417\""
Jul 29 03:07:58.180429 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.180393    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:07:58.208324 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.208287    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:07:58.211752 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.211730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.222587 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.222559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:07:58.320443 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.320409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkjg\" (UniqueName: \"kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.320677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.320454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.320677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.320512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.320677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.320599    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8s2\" (UniqueName: \"kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.421846 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.421742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.421846 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.421798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8s2\" (UniqueName: \"kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.422091 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.421851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkjg\" (UniqueName: \"kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.422091 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.421879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.422641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.422616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.422744 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.422619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.430728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.430699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkjg\" (UniqueName: \"kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg\") pod \"payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.430728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.430713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8s2\" (UniqueName: \"kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2\") pod \"payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") " pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.474991 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.474951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.522888 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.522850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.643297 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.643264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:07:58.644697 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:07:58.644668    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b3f53b_6e1f_4aee_af03_920969bf445b.slice/crio-0e5ce2452b0e111c3475a83e06ad2231e16286f7c489f2a960d582805b03b173 WatchSource:0}: Error finding container 0e5ce2452b0e111c3475a83e06ad2231e16286f7c489f2a960d582805b03b173: Status 404 returned error can't find the container with id 0e5ce2452b0e111c3475a83e06ad2231e16286f7c489f2a960d582805b03b173
Jul 29 03:07:58.708411 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.708354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:07:58.708893 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:07:58.708866    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7b7b8e_57f5_492b_9ced_7fba7bc1e9d8.slice/crio-41b2d6bd287e979073b90b38e6be08768bd9d924acfcc273c04cae921477db41 WatchSource:0}: Error finding container 41b2d6bd287e979073b90b38e6be08768bd9d924acfcc273c04cae921477db41: Status 404 returned error can't find the container with id 41b2d6bd287e979073b90b38e6be08768bd9d924acfcc273c04cae921477db41
Jul 29 03:07:58.849817 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.849775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" event={"ID":"e2b3f53b-6e1f-4aee-af03-920969bf445b","Type":"ContainerStarted","Data":"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"}
Jul 29 03:07:58.850019 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.849834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" event={"ID":"e2b3f53b-6e1f-4aee-af03-920969bf445b","Type":"ContainerStarted","Data":"0e5ce2452b0e111c3475a83e06ad2231e16286f7c489f2a960d582805b03b173"}
Jul 29 03:07:58.850019 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.849873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:07:58.851569 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.851539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" event={"ID":"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8","Type":"ContainerStarted","Data":"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"}
Jul 29 03:07:58.851689 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.851593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" event={"ID":"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8","Type":"ContainerStarted","Data":"41b2d6bd287e979073b90b38e6be08768bd9d924acfcc273c04cae921477db41"}
Jul 29 03:07:58.851689 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.851621    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:07:58.873887 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.873822    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" podStartSLOduration=0.873799987 podStartE2EDuration="873.799987ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:07:58.871117362 +0000 UTC m=+1976.905834046" watchObservedRunningTime="2026-07-29 03:07:58.873799987 +0000 UTC m=+1976.908516678"
Jul 29 03:07:58.893167 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:07:58.893101    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" podStartSLOduration=0.893081975 podStartE2EDuration="893.081975ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:07:58.891082074 +0000 UTC m=+1976.925798765" watchObservedRunningTime="2026-07-29 03:07:58.893081975 +0000 UTC m=+1976.927798662"
Jul 29 03:08:09.859359 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:08:09.859319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:08:09.859748 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:08:09.859407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:09:07.051408 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.051366    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"]
Jul 29 03:09:07.054910 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.054879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:07.057594 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.057533    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:09:07.057594 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.057553    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:09:07.062552 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.062520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"]
Jul 29 03:09:07.132419 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.132370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c659b417-t8p49\" (UID: \"4bb174c7-73ac-4ed4-bc73-4479fa38788f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:07.233090 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.233046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c659b417-t8p49\" (UID: \"4bb174c7-73ac-4ed4-bc73-4479fa38788f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:07.233731 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.233710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c659b417-t8p49\" (UID: \"4bb174c7-73ac-4ed4-bc73-4479fa38788f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:07.371169 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.371072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:07.521358 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:07.521331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"]
Jul 29 03:09:07.523006 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:09:07.522979    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb174c7_73ac_4ed4_bc73_4479fa38788f.slice/crio-e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867 WatchSource:0}: Error finding container e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867: Status 404 returned error can't find the container with id e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867
Jul 29 03:09:08.250914 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:08.250878    2560 generic.go:356] "Generic (PLEG): container finished" podID="4bb174c7-73ac-4ed4-bc73-4479fa38788f" containerID="aaf3bc4d2261b79a16469f44d0c6494eab8063d3c3bd1971a9d5e20de07bd985" exitCode=0
Jul 29 03:09:08.251334 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:08.250966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49" event={"ID":"4bb174c7-73ac-4ed4-bc73-4479fa38788f","Type":"ContainerDied","Data":"aaf3bc4d2261b79a16469f44d0c6494eab8063d3c3bd1971a9d5e20de07bd985"}
Jul 29 03:09:08.251334 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:08.251024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49" event={"ID":"4bb174c7-73ac-4ed4-bc73-4479fa38788f","Type":"ContainerStarted","Data":"e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867"}
Jul 29 03:09:09.393150 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:09.393123    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:09.452812 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:09.452779    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca\") pod \"4bb174c7-73ac-4ed4-bc73-4479fa38788f\" (UID: \"4bb174c7-73ac-4ed4-bc73-4479fa38788f\") "
Jul 29 03:09:09.453161 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:09.453137    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4bb174c7-73ac-4ed4-bc73-4479fa38788f" (UID: "4bb174c7-73ac-4ed4-bc73-4479fa38788f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:09:09.554032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:09.553938    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb174c7-73ac-4ed4-bc73-4479fa38788f-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:09:10.263671 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:10.263640    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"
Jul 29 03:09:10.263862 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:10.263675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49" event={"ID":"4bb174c7-73ac-4ed4-bc73-4479fa38788f","Type":"ContainerDied","Data":"e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867"}
Jul 29 03:09:10.263862 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:10.263721    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e214934eb81ba442b4ac67098b498087fbe79926526de076f2399ec579711867"
Jul 29 03:09:22.658370 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.658321    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:09:22.658871 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.658586    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" podUID="e2b3f53b-6e1f-4aee-af03-920969bf445b" containerName="payload-processing" containerID="cri-o://ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d" gracePeriod=30
Jul 29 03:09:22.666730 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.666694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:09:22.666967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.666937    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" podUID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" containerName="payload-pre-processing" containerID="cri-o://4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12" gracePeriod=30
Jul 29 03:09:22.825011 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.824965    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"]
Jul 29 03:09:22.828397 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.828366    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c659b417-t8p49"]
Jul 29 03:09:22.950103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.950070    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:09:22.953311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:22.953287    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:09:23.073008 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.072964    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkjg\" (UniqueName: \"kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg\") pod \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") "
Jul 29 03:09:23.073008 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.073014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume\") pod \"e2b3f53b-6e1f-4aee-af03-920969bf445b\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") "
Jul 29 03:09:23.073281 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.073071    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq8s2\" (UniqueName: \"kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2\") pod \"e2b3f53b-6e1f-4aee-af03-920969bf445b\" (UID: \"e2b3f53b-6e1f-4aee-af03-920969bf445b\") "
Jul 29 03:09:23.073281 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.073099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume\") pod \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\" (UID: \"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8\") "
Jul 29 03:09:23.073572 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.073539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2b3f53b-6e1f-4aee-af03-920969bf445b" (UID: "e2b3f53b-6e1f-4aee-af03-920969bf445b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:09:23.073705 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.073541    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" (UID: "df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:09:23.075312 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.075283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2" (OuterVolumeSpecName: "kube-api-access-gq8s2") pod "e2b3f53b-6e1f-4aee-af03-920969bf445b" (UID: "e2b3f53b-6e1f-4aee-af03-920969bf445b"). InnerVolumeSpecName "kube-api-access-gq8s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:09:23.075393 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.075314    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg" (OuterVolumeSpecName: "kube-api-access-jxkjg") pod "df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" (UID: "df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8"). InnerVolumeSpecName "kube-api-access-jxkjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:09:23.174723 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.174691    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq8s2\" (UniqueName: \"kubernetes.io/projected/e2b3f53b-6e1f-4aee-af03-920969bf445b-kube-api-access-gq8s2\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:09:23.174723 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.174724    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:09:23.174892 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.174734    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkjg\" (UniqueName: \"kubernetes.io/projected/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8-kube-api-access-jxkjg\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:09:23.174892 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.174744    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b3f53b-6e1f-4aee-af03-920969bf445b-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:09:23.340434 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.340389    2560 generic.go:356] "Generic (PLEG): container finished" podID="e2b3f53b-6e1f-4aee-af03-920969bf445b" containerID="ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d" exitCode=0
Jul 29 03:09:23.340641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.340444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"
Jul 29 03:09:23.340641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.340486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" event={"ID":"e2b3f53b-6e1f-4aee-af03-920969bf445b","Type":"ContainerDied","Data":"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"}
Jul 29 03:09:23.340641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.340590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb" event={"ID":"e2b3f53b-6e1f-4aee-af03-920969bf445b","Type":"ContainerDied","Data":"0e5ce2452b0e111c3475a83e06ad2231e16286f7c489f2a960d582805b03b173"}
Jul 29 03:09:23.340641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.340620    2560 scope.go:117] "RemoveContainer" containerID="ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"
Jul 29 03:09:23.341932 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.341905    2560 generic.go:356] "Generic (PLEG): container finished" podID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" containerID="4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12" exitCode=0
Jul 29 03:09:23.342012 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.341948    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"
Jul 29 03:09:23.342053 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.341943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" event={"ID":"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8","Type":"ContainerDied","Data":"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"}
Jul 29 03:09:23.342094 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.342064    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j" event={"ID":"df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8","Type":"ContainerDied","Data":"41b2d6bd287e979073b90b38e6be08768bd9d924acfcc273c04cae921477db41"}
Jul 29 03:09:23.351078 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.351040    2560 scope.go:117] "RemoveContainer" containerID="ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"
Jul 29 03:09:23.351457 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:09:23.351435    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d\": container with ID starting with ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d not found: ID does not exist" containerID="ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"
Jul 29 03:09:23.351555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.351464    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d"} err="failed to get container status \"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d\": rpc error: code = NotFound desc = could not find container \"ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d\": container with ID starting with ef2372dde505a06aeb490bd443cabf27766bef3426e96f3ace39ab30e224f88d not found: ID does not exist"
Jul 29 03:09:23.351555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.351483    2560 scope.go:117] "RemoveContainer" containerID="4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"
Jul 29 03:09:23.360785 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.360766    2560 scope.go:117] "RemoveContainer" containerID="4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"
Jul 29 03:09:23.361127 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:09:23.361107    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12\": container with ID starting with 4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12 not found: ID does not exist" containerID="4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"
Jul 29 03:09:23.361182 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.361135    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12"} err="failed to get container status \"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12\": rpc error: code = NotFound desc = could not find container \"4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12\": container with ID starting with 4ea1c7e782b628f76ee586a9ca438b2e2002544d700d47741674123506237b12 not found: ID does not exist"
Jul 29 03:09:23.372180 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.372145    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:09:23.376439 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.376410    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c659b417-78fddd54b6-rp6sb"]
Jul 29 03:09:23.386946 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.386910    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:09:23.390445 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:23.390415    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c659b417-647dbf6c6d-fpn4j"]
Jul 29 03:09:24.408518 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:24.408437    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb174c7-73ac-4ed4-bc73-4479fa38788f" path="/var/lib/kubelet/pods/4bb174c7-73ac-4ed4-bc73-4479fa38788f/volumes"
Jul 29 03:09:24.408889 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:24.408842    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" path="/var/lib/kubelet/pods/df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8/volumes"
Jul 29 03:09:24.409202 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:09:24.409188    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b3f53b-6e1f-4aee-af03-920969bf445b" path="/var/lib/kubelet/pods/e2b3f53b-6e1f-4aee-af03-920969bf445b/volumes"
Jul 29 03:10:02.687091 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:10:02.687063    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:10:02.699479 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:10:02.699451    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:10:02.724312 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:10:02.724275    2560 scope.go:117] "RemoveContainer" containerID="7275429881d097abb2fc730213e16f6427ee1cda409da38f89d58819a1fc64b5"
Jul 29 03:10:02.733766 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:10:02.733741    2560 scope.go:117] "RemoveContainer" containerID="06634938216f210532db2a35c3a9623a683fd0ff7e139706df79d7a696cbe3a0"
Jul 29 03:11:02.769297 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:02.769198    2560 scope.go:117] "RemoveContainer" containerID="c27f033c1d69d029229063817e21f2ba13ab16c65bcb32dd20a83840179abefc"
Jul 29 03:11:02.778817 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:02.778792    2560 scope.go:117] "RemoveContainer" containerID="c9865c2ff8209177a6b463c89938cba40697e9a08f122c311cd1f44e6834739b"
Jul 29 03:11:13.246992 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.246955    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247338    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb174c7-73ac-4ed4-bc73-4479fa38788f" containerName="revoke-keys"
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247351    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb174c7-73ac-4ed4-bc73-4479fa38788f" containerName="revoke-keys"
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247367    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" containerName="payload-pre-processing"
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247372    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" containerName="payload-pre-processing"
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247380    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b3f53b-6e1f-4aee-af03-920969bf445b" containerName="payload-processing"
Jul 29 03:11:13.247437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247387    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b3f53b-6e1f-4aee-af03-920969bf445b" containerName="payload-processing"
Jul 29 03:11:13.247628 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247450    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb174c7-73ac-4ed4-bc73-4479fa38788f" containerName="revoke-keys"
Jul 29 03:11:13.247628 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247460    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="df7b7b8e-57f5-492b-9ced-7fba7bc1e9d8" containerName="payload-pre-processing"
Jul 29 03:11:13.247628 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.247468    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b3f53b-6e1f-4aee-af03-920969bf445b" containerName="payload-processing"
Jul 29 03:11:13.250518 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.250496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.253353 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.253328    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e2d41c\""
Jul 29 03:11:13.253514 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.253489    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-e2d41c-dockercfg-p2s58\""
Jul 29 03:11:13.260497 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.260463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:11:13.274274 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.274210    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:11:13.277867 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.277840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.287386 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.287359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:11:13.352045 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.352003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbvj7\" (UniqueName: \"kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.352228 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.352131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.352228 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.352202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsp88\" (UniqueName: \"kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.352325 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.352272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.453442 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.453383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.453677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.453461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsp88\" (UniqueName: \"kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.453677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.453512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.453677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.453565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbvj7\" (UniqueName: \"kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.454298 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.454238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.454354 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.454285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.464292 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.462851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsp88\" (UniqueName: \"kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88\") pod \"payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.470125 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.470083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbvj7\" (UniqueName: \"kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7\") pod \"payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.562934 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.562819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.592770 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.592728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.727571 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.727532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:11:13.728948 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:11:13.728914    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc54ce74_1376_4ccf_8dff_574614d6c69d.slice/crio-5009f0203fd300f970527a98f281520abf16fc2aa66713fc334de31e93c6ae49 WatchSource:0}: Error finding container 5009f0203fd300f970527a98f281520abf16fc2aa66713fc334de31e93c6ae49: Status 404 returned error can't find the container with id 5009f0203fd300f970527a98f281520abf16fc2aa66713fc334de31e93c6ae49
Jul 29 03:11:13.760012 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.759973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:11:13.771659 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:11:13.771626    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20badf8a_2916_466b_b34e_7e7ebc8b9f2d.slice/crio-5d87cfbad244f7ad73ba6f4f2ff789622e2803ce97b41f6879bc04e19e74184a WatchSource:0}: Error finding container 5d87cfbad244f7ad73ba6f4f2ff789622e2803ce97b41f6879bc04e19e74184a: Status 404 returned error can't find the container with id 5d87cfbad244f7ad73ba6f4f2ff789622e2803ce97b41f6879bc04e19e74184a
Jul 29 03:11:13.962588 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.962553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" event={"ID":"cc54ce74-1376-4ccf-8dff-574614d6c69d","Type":"ContainerStarted","Data":"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"}
Jul 29 03:11:13.962794 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.962611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" event={"ID":"cc54ce74-1376-4ccf-8dff-574614d6c69d","Type":"ContainerStarted","Data":"5009f0203fd300f970527a98f281520abf16fc2aa66713fc334de31e93c6ae49"}
Jul 29 03:11:13.962794 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.962737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:13.964121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.964087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" event={"ID":"20badf8a-2916-466b-b34e-7e7ebc8b9f2d","Type":"ContainerStarted","Data":"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"}
Jul 29 03:11:13.964241 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.964135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" event={"ID":"20badf8a-2916-466b-b34e-7e7ebc8b9f2d","Type":"ContainerStarted","Data":"5d87cfbad244f7ad73ba6f4f2ff789622e2803ce97b41f6879bc04e19e74184a"}
Jul 29 03:11:13.964241 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.964155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:13.981282 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.981185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" podStartSLOduration=0.981168326 podStartE2EDuration="981.168326ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:11:13.978993486 +0000 UTC m=+2172.013710183" watchObservedRunningTime="2026-07-29 03:11:13.981168326 +0000 UTC m=+2172.015885045"
Jul 29 03:11:13.997424 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:13.997363    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" podStartSLOduration=0.997336191 podStartE2EDuration="997.336191ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:11:13.994561917 +0000 UTC m=+2172.029278687" watchObservedRunningTime="2026-07-29 03:11:13.997336191 +0000 UTC m=+2172.032052883"
Jul 29 03:11:24.972314 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:24.972279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:11:24.972805 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:24.972454    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:11:42.341740 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.341694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:11:42.345298 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.345276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.348121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.348097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2f84e8-dockercfg-cn2v7\""
Jul 29 03:11:42.348281 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.348134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2f84e8\""
Jul 29 03:11:42.355172 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.355144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:11:42.372910 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.372874    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:11:42.376173 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.376151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.385458 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.385422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:11:42.419584 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.419536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.419776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.419637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.419776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.419675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx44j\" (UniqueName: \"kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.419776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.419694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqfs\" (UniqueName: \"kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.520910 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.520872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.520910 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.520912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx44j\" (UniqueName: \"kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.521143 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.520932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqfs\" (UniqueName: \"kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.521143 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.521014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.521691 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.521672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.521751 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.521734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.530827 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.530793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx44j\" (UniqueName: \"kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j\") pod \"payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.531040 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.531016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqfs\" (UniqueName: \"kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs\") pod \"payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.658936 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.658829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:42.688281 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.688234    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:42.820871 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.820827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:11:42.821111 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:11:42.821086    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8dfc44_2df5_484c_bdd4_80f45f053caf.slice/crio-03e45cee2f33dc2c95584528a24c85e41d65eec8d6657e9387021baf583dd8ec WatchSource:0}: Error finding container 03e45cee2f33dc2c95584528a24c85e41d65eec8d6657e9387021baf583dd8ec: Status 404 returned error can't find the container with id 03e45cee2f33dc2c95584528a24c85e41d65eec8d6657e9387021baf583dd8ec
Jul 29 03:11:42.843328 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:42.843290    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:11:42.845643 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:11:42.845606    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f64f608_6d74_4682_a83f_77244f632d7c.slice/crio-5c33837fe2cd83370521e2e45cd6c56304321321e35a58ead9a8b98813db3b25 WatchSource:0}: Error finding container 5c33837fe2cd83370521e2e45cd6c56304321321e35a58ead9a8b98813db3b25: Status 404 returned error can't find the container with id 5c33837fe2cd83370521e2e45cd6c56304321321e35a58ead9a8b98813db3b25
Jul 29 03:11:43.137043 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.137002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" event={"ID":"0b8dfc44-2df5-484c-bdd4-80f45f053caf","Type":"ContainerStarted","Data":"c8e5e1877eb2efec4b5ef1096b730b7666a58358ec3722f965b955f29d7657ef"}
Jul 29 03:11:43.137269 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.137068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" event={"ID":"0b8dfc44-2df5-484c-bdd4-80f45f053caf","Type":"ContainerStarted","Data":"03e45cee2f33dc2c95584528a24c85e41d65eec8d6657e9387021baf583dd8ec"}
Jul 29 03:11:43.137269 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.137189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:43.138674 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.138648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" event={"ID":"2f64f608-6d74-4682-a83f-77244f632d7c","Type":"ContainerStarted","Data":"ca401e84075c7c6895f2dc88df937b6030186942df6561b613c5add078256fe2"}
Jul 29 03:11:43.138805 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.138705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:11:43.138805 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.138724    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" event={"ID":"2f64f608-6d74-4682-a83f-77244f632d7c","Type":"ContainerStarted","Data":"5c33837fe2cd83370521e2e45cd6c56304321321e35a58ead9a8b98813db3b25"}
Jul 29 03:11:43.156168 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.156106    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" podStartSLOduration=1.156089668 podStartE2EDuration="1.156089668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:11:43.153141829 +0000 UTC m=+2201.187858544" watchObservedRunningTime="2026-07-29 03:11:43.156089668 +0000 UTC m=+2201.190806358"
Jul 29 03:11:43.175271 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:43.173187    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" podStartSLOduration=1.173164291 podStartE2EDuration="1.173164291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:11:43.170209462 +0000 UTC m=+2201.204926165" watchObservedRunningTime="2026-07-29 03:11:43.173164291 +0000 UTC m=+2201.207880982"
Jul 29 03:11:54.146108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:54.146071    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:11:54.146600 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:11:54.146149    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:13:52.893078 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.893043    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"]
Jul 29 03:13:52.896451 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.896431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:52.899371 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.899347    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:13:52.899479 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.899347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:13:52.905742 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.905715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"]
Jul 29 03:13:52.999765 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:52.999732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c\" (UID: \"ca2e8348-f791-4eb2-959a-49800d2ac30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:53.100680 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:53.100650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c\" (UID: \"ca2e8348-f791-4eb2-959a-49800d2ac30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:53.101348 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:53.101330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c\" (UID: \"ca2e8348-f791-4eb2-959a-49800d2ac30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:53.208495 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:53.208466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:53.553976 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:53.553943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"]
Jul 29 03:13:53.554929 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:13:53.554904    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2e8348_f791_4eb2_959a_49800d2ac30f.slice/crio-55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1 WatchSource:0}: Error finding container 55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1: Status 404 returned error can't find the container with id 55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1
Jul 29 03:13:53.875809 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:53.875727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c" event={"ID":"ca2e8348-f791-4eb2-959a-49800d2ac30f","Type":"ContainerStarted","Data":"55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1"}
Jul 29 03:13:54.882698 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:54.882662    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca2e8348-f791-4eb2-959a-49800d2ac30f" containerID="86a451d35a527084221fec16c8f50056227fd0ae0116e79b80c3b72acfc042c2" exitCode=0
Jul 29 03:13:54.883110 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:54.882722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c" event={"ID":"ca2e8348-f791-4eb2-959a-49800d2ac30f","Type":"ContainerDied","Data":"86a451d35a527084221fec16c8f50056227fd0ae0116e79b80c3b72acfc042c2"}
Jul 29 03:13:56.039115 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.039083    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:56.128179 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.128138    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca\") pod \"ca2e8348-f791-4eb2-959a-49800d2ac30f\" (UID: \"ca2e8348-f791-4eb2-959a-49800d2ac30f\") "
Jul 29 03:13:56.128581 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.128557    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca2e8348-f791-4eb2-959a-49800d2ac30f" (UID: "ca2e8348-f791-4eb2-959a-49800d2ac30f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:13:56.229620 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.229586    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2e8348-f791-4eb2-959a-49800d2ac30f-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:13:56.895311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.895279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"
Jul 29 03:13:56.895311 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.895306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c" event={"ID":"ca2e8348-f791-4eb2-959a-49800d2ac30f","Type":"ContainerDied","Data":"55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1"}
Jul 29 03:13:56.895560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:13:56.895360    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55012d6cf21922592475f657b059bc4c9b55a0ace42bbdef612eddcef3f92fb1"
Jul 29 03:14:02.822660 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:02.822627    2560 scope.go:117] "RemoveContainer" containerID="35f817ced8fe36e51eda8324f0d38f4fd3e0138a3b89a6ccb111205385d6e33b"
Jul 29 03:14:03.520774 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.520736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:14:03.520996 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.520957    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" podUID="cc54ce74-1376-4ccf-8dff-574614d6c69d" containerName="payload-processing" containerID="cri-o://5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548" gracePeriod=30
Jul 29 03:14:03.529707 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.529671    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:14:03.530521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.530403    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" podUID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" containerName="payload-pre-processing" containerID="cri-o://762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1" gracePeriod=30
Jul 29 03:14:03.690907 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.690859    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"]
Jul 29 03:14:03.694675 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.694621    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e2d41c-4qj9c"]
Jul 29 03:14:03.821423 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.821395    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:14:03.824758 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.824722    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:14:03.935004 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.934968    2560 generic.go:356] "Generic (PLEG): container finished" podID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" containerID="762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1" exitCode=0
Jul 29 03:14:03.935004 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.935009    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"
Jul 29 03:14:03.935221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.935056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" event={"ID":"20badf8a-2916-466b-b34e-7e7ebc8b9f2d","Type":"ContainerDied","Data":"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"}
Jul 29 03:14:03.935221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.935109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct" event={"ID":"20badf8a-2916-466b-b34e-7e7ebc8b9f2d","Type":"ContainerDied","Data":"5d87cfbad244f7ad73ba6f4f2ff789622e2803ce97b41f6879bc04e19e74184a"}
Jul 29 03:14:03.935221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.935140    2560 scope.go:117] "RemoveContainer" containerID="762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"
Jul 29 03:14:03.936619 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.936596    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc54ce74-1376-4ccf-8dff-574614d6c69d" containerID="5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548" exitCode=0
Jul 29 03:14:03.936681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.936631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" event={"ID":"cc54ce74-1376-4ccf-8dff-574614d6c69d","Type":"ContainerDied","Data":"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"}
Jul 29 03:14:03.936681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.936643    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"
Jul 29 03:14:03.936681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.936670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w" event={"ID":"cc54ce74-1376-4ccf-8dff-574614d6c69d","Type":"ContainerDied","Data":"5009f0203fd300f970527a98f281520abf16fc2aa66713fc334de31e93c6ae49"}
Jul 29 03:14:03.944608 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.944584    2560 scope.go:117] "RemoveContainer" containerID="762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"
Jul 29 03:14:03.944931 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:14:03.944909    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1\": container with ID starting with 762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1 not found: ID does not exist" containerID="762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"
Jul 29 03:14:03.945016 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.944938    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1"} err="failed to get container status \"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1\": rpc error: code = NotFound desc = could not find container \"762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1\": container with ID starting with 762b0d0d82f4b27b6543520d1bdc6181de2c7cec4a96da365b66b73b0ec108c1 not found: ID does not exist"
Jul 29 03:14:03.945016 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.944955    2560 scope.go:117] "RemoveContainer" containerID="5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"
Jul 29 03:14:03.954166 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.954141    2560 scope.go:117] "RemoveContainer" containerID="5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"
Jul 29 03:14:03.954545 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:14:03.954521    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548\": container with ID starting with 5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548 not found: ID does not exist" containerID="5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"
Jul 29 03:14:03.954597 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:03.954556    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548"} err="failed to get container status \"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548\": rpc error: code = NotFound desc = could not find container \"5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548\": container with ID starting with 5d9eb68ee315769634d8346d6bb892f8470127b7b1ae87e4390eb85dcc149548 not found: ID does not exist"
Jul 29 03:14:04.004375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume\") pod \"cc54ce74-1376-4ccf-8dff-574614d6c69d\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") "
Jul 29 03:14:04.004542 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004424    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume\") pod \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") "
Jul 29 03:14:04.004542 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsp88\" (UniqueName: \"kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88\") pod \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\" (UID: \"20badf8a-2916-466b-b34e-7e7ebc8b9f2d\") "
Jul 29 03:14:04.004542 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbvj7\" (UniqueName: \"kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7\") pod \"cc54ce74-1376-4ccf-8dff-574614d6c69d\" (UID: \"cc54ce74-1376-4ccf-8dff-574614d6c69d\") "
Jul 29 03:14:04.004806 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004782    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc54ce74-1376-4ccf-8dff-574614d6c69d" (UID: "cc54ce74-1376-4ccf-8dff-574614d6c69d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:14:04.004872 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.004784    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20badf8a-2916-466b-b34e-7e7ebc8b9f2d" (UID: "20badf8a-2916-466b-b34e-7e7ebc8b9f2d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:14:04.006599 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.006574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7" (OuterVolumeSpecName: "kube-api-access-hbvj7") pod "cc54ce74-1376-4ccf-8dff-574614d6c69d" (UID: "cc54ce74-1376-4ccf-8dff-574614d6c69d"). InnerVolumeSpecName "kube-api-access-hbvj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:04.006683 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.006662    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88" (OuterVolumeSpecName: "kube-api-access-hsp88") pod "20badf8a-2916-466b-b34e-7e7ebc8b9f2d" (UID: "20badf8a-2916-466b-b34e-7e7ebc8b9f2d"). InnerVolumeSpecName "kube-api-access-hsp88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:04.105652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.105557    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbvj7\" (UniqueName: \"kubernetes.io/projected/cc54ce74-1376-4ccf-8dff-574614d6c69d-kube-api-access-hbvj7\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:04.105652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.105592    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc54ce74-1376-4ccf-8dff-574614d6c69d-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:04.105652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.105602    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:04.105652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.105611    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsp88\" (UniqueName: \"kubernetes.io/projected/20badf8a-2916-466b-b34e-7e7ebc8b9f2d-kube-api-access-hsp88\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:04.265533 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.265491    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:14:04.268101 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.268069    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e2d41c-8594dd65bd-sbkct"]
Jul 29 03:14:04.278337 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.278301    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:14:04.281917 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.281884    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e2d41c-547bb7fd96-c2h7w"]
Jul 29 03:14:04.408341 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.408234    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" path="/var/lib/kubelet/pods/20badf8a-2916-466b-b34e-7e7ebc8b9f2d/volumes"
Jul 29 03:14:04.408594 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.408581    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2e8348-f791-4eb2-959a-49800d2ac30f" path="/var/lib/kubelet/pods/ca2e8348-f791-4eb2-959a-49800d2ac30f/volumes"
Jul 29 03:14:04.408899 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:04.408887    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc54ce74-1376-4ccf-8dff-574614d6c69d" path="/var/lib/kubelet/pods/cc54ce74-1376-4ccf-8dff-574614d6c69d/volumes"
Jul 29 03:14:10.359126 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359080    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"]
Jul 29 03:14:10.359555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359520    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2e8348-f791-4eb2-959a-49800d2ac30f" containerName="revoke-keys"
Jul 29 03:14:10.359555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359536    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2e8348-f791-4eb2-959a-49800d2ac30f" containerName="revoke-keys"
Jul 29 03:14:10.359555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359549    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc54ce74-1376-4ccf-8dff-574614d6c69d" containerName="payload-processing"
Jul 29 03:14:10.359555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359554    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc54ce74-1376-4ccf-8dff-574614d6c69d" containerName="payload-processing"
Jul 29 03:14:10.359688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" containerName="payload-pre-processing"
Jul 29 03:14:10.359688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359569    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" containerName="payload-pre-processing"
Jul 29 03:14:10.359688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359640    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc54ce74-1376-4ccf-8dff-574614d6c69d" containerName="payload-processing"
Jul 29 03:14:10.359688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359647    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="20badf8a-2916-466b-b34e-7e7ebc8b9f2d" containerName="payload-pre-processing"
Jul 29 03:14:10.359688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.359656    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2e8348-f791-4eb2-959a-49800d2ac30f" containerName="revoke-keys"
Jul 29 03:14:10.362758 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.362741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:10.365405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.365374    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:14:10.365405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.365391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:14:10.370009 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.369979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"]
Jul 29 03:14:10.458371 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.458327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62\" (UID: \"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:10.558929 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.558884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62\" (UID: \"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:10.559624 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.559600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62\" (UID: \"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:10.675444 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.675414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:10.820280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.820124    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"]
Jul 29 03:14:10.823086 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:14:10.823056    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ae9ed2_3f32_424a_9f01_4fa8dd86d003.slice/crio-5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee WatchSource:0}: Error finding container 5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee: Status 404 returned error can't find the container with id 5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee
Jul 29 03:14:10.981381 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:10.981296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62" event={"ID":"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003","Type":"ContainerStarted","Data":"5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee"}
Jul 29 03:14:11.988611 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:11.988580    2560 generic.go:356] "Generic (PLEG): container finished" podID="a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" containerID="60e171728b190f6a2f0291bda2c5e39edbc34590f52bef3bcbc20a68e2aab716" exitCode=0
Jul 29 03:14:11.988991 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:11.988675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62" event={"ID":"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003","Type":"ContainerDied","Data":"60e171728b190f6a2f0291bda2c5e39edbc34590f52bef3bcbc20a68e2aab716"}
Jul 29 03:14:13.134845 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:13.134818    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:13.178021 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:13.177984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca\") pod \"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003\" (UID: \"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003\") "
Jul 29 03:14:13.178428 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:13.178404    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" (UID: "a2ae9ed2-3f32-424a-9f01-4fa8dd86d003"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:14:13.278652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:13.278539    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:14.001587 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:14.001556    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"
Jul 29 03:14:14.001776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:14.001552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62" event={"ID":"a2ae9ed2-3f32-424a-9f01-4fa8dd86d003","Type":"ContainerDied","Data":"5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee"}
Jul 29 03:14:14.001776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:14.001681    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ca7b081e3b9624e155b8d151bc0134945abe4b2077fdc2cd99aa52d58920dee"
Jul 29 03:14:20.859464 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:20.859427    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:14:20.859933 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:20.859696    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" podUID="2f64f608-6d74-4682-a83f-77244f632d7c" containerName="payload-processing" containerID="cri-o://ca401e84075c7c6895f2dc88df937b6030186942df6561b613c5add078256fe2" gracePeriod=30
Jul 29 03:14:20.865305 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:20.865273    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:14:20.865523 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:20.865499    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" podUID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" containerName="payload-pre-processing" containerID="cri-o://c8e5e1877eb2efec4b5ef1096b730b7666a58358ec3722f965b955f29d7657ef" gracePeriod=30
Jul 29 03:14:21.013557 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.013522    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"]
Jul 29 03:14:21.017427 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.017355    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f84e8-lfp62"]
Jul 29 03:14:21.047639 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.047594    2560 generic.go:356] "Generic (PLEG): container finished" podID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" containerID="c8e5e1877eb2efec4b5ef1096b730b7666a58358ec3722f965b955f29d7657ef" exitCode=0
Jul 29 03:14:21.047842 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.047664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" event={"ID":"0b8dfc44-2df5-484c-bdd4-80f45f053caf","Type":"ContainerDied","Data":"c8e5e1877eb2efec4b5ef1096b730b7666a58358ec3722f965b955f29d7657ef"}
Jul 29 03:14:21.059481 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.059440    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f64f608-6d74-4682-a83f-77244f632d7c" containerID="ca401e84075c7c6895f2dc88df937b6030186942df6561b613c5add078256fe2" exitCode=0
Jul 29 03:14:21.059884 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.059860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" event={"ID":"2f64f608-6d74-4682-a83f-77244f632d7c","Type":"ContainerDied","Data":"ca401e84075c7c6895f2dc88df937b6030186942df6561b613c5add078256fe2"}
Jul 29 03:14:21.161217 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.161188    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:14:21.164377 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.164352    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:14:21.245740 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.245702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume\") pod \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") "
Jul 29 03:14:21.245740 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.245747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx44j\" (UniqueName: \"kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j\") pod \"2f64f608-6d74-4682-a83f-77244f632d7c\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") "
Jul 29 03:14:21.245998 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.245776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvqfs\" (UniqueName: \"kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs\") pod \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\" (UID: \"0b8dfc44-2df5-484c-bdd4-80f45f053caf\") "
Jul 29 03:14:21.245998 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.245825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume\") pod \"2f64f608-6d74-4682-a83f-77244f632d7c\" (UID: \"2f64f608-6d74-4682-a83f-77244f632d7c\") "
Jul 29 03:14:21.246222 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.246198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b8dfc44-2df5-484c-bdd4-80f45f053caf" (UID: "0b8dfc44-2df5-484c-bdd4-80f45f053caf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:14:21.246316 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.246278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f64f608-6d74-4682-a83f-77244f632d7c" (UID: "2f64f608-6d74-4682-a83f-77244f632d7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:14:21.248024 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.248000    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs" (OuterVolumeSpecName: "kube-api-access-bvqfs") pod "0b8dfc44-2df5-484c-bdd4-80f45f053caf" (UID: "0b8dfc44-2df5-484c-bdd4-80f45f053caf"). InnerVolumeSpecName "kube-api-access-bvqfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:21.248102 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.248026    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j" (OuterVolumeSpecName: "kube-api-access-cx44j") pod "2f64f608-6d74-4682-a83f-77244f632d7c" (UID: "2f64f608-6d74-4682-a83f-77244f632d7c"). InnerVolumeSpecName "kube-api-access-cx44j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:21.347536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.347482    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8dfc44-2df5-484c-bdd4-80f45f053caf-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:21.347536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.347524    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx44j\" (UniqueName: \"kubernetes.io/projected/2f64f608-6d74-4682-a83f-77244f632d7c-kube-api-access-cx44j\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:21.347536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.347536    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvqfs\" (UniqueName: \"kubernetes.io/projected/0b8dfc44-2df5-484c-bdd4-80f45f053caf-kube-api-access-bvqfs\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:21.347536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:21.347548    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f64f608-6d74-4682-a83f-77244f632d7c-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:14:22.067412 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.067378    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"
Jul 29 03:14:22.067814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.067416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26" event={"ID":"0b8dfc44-2df5-484c-bdd4-80f45f053caf","Type":"ContainerDied","Data":"03e45cee2f33dc2c95584528a24c85e41d65eec8d6657e9387021baf583dd8ec"}
Jul 29 03:14:22.067814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.067485    2560 scope.go:117] "RemoveContainer" containerID="c8e5e1877eb2efec4b5ef1096b730b7666a58358ec3722f965b955f29d7657ef"
Jul 29 03:14:22.069055 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.069038    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"
Jul 29 03:14:22.069124 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.069062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z" event={"ID":"2f64f608-6d74-4682-a83f-77244f632d7c","Type":"ContainerDied","Data":"5c33837fe2cd83370521e2e45cd6c56304321321e35a58ead9a8b98813db3b25"}
Jul 29 03:14:22.093472 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.093436    2560 scope.go:117] "RemoveContainer" containerID="ca401e84075c7c6895f2dc88df937b6030186942df6561b613c5add078256fe2"
Jul 29 03:14:22.108821 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.108788    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:14:22.112885 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.112854    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2f84e8-764f8c7598-mdp5z"]
Jul 29 03:14:22.124525 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.124487    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:14:22.128227 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.128196    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2f84e8-6dd76fb548-w9w26"]
Jul 29 03:14:22.408916 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.408875    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" path="/var/lib/kubelet/pods/0b8dfc44-2df5-484c-bdd4-80f45f053caf/volumes"
Jul 29 03:14:22.409259 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.409235    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f64f608-6d74-4682-a83f-77244f632d7c" path="/var/lib/kubelet/pods/2f64f608-6d74-4682-a83f-77244f632d7c/volumes"
Jul 29 03:14:22.409544 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:22.409531    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" path="/var/lib/kubelet/pods/a2ae9ed2-3f32-424a-9f01-4fa8dd86d003/volumes"
Jul 29 03:14:32.233794 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.233750    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:14:32.235076 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235035    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" containerName="revoke-keys"
Jul 29 03:14:32.235076 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235076    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" containerName="revoke-keys"
Jul 29 03:14:32.235280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235121    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f64f608-6d74-4682-a83f-77244f632d7c" containerName="payload-processing"
Jul 29 03:14:32.235280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235132    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f64f608-6d74-4682-a83f-77244f632d7c" containerName="payload-processing"
Jul 29 03:14:32.235280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235163    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" containerName="payload-pre-processing"
Jul 29 03:14:32.235280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235174    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" containerName="payload-pre-processing"
Jul 29 03:14:32.235486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235366    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2ae9ed2-3f32-424a-9f01-4fa8dd86d003" containerName="revoke-keys"
Jul 29 03:14:32.235486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235380    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8dfc44-2df5-484c-bdd4-80f45f053caf" containerName="payload-pre-processing"
Jul 29 03:14:32.235486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.235399    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f64f608-6d74-4682-a83f-77244f632d7c" containerName="payload-processing"
Jul 29 03:14:32.239624 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.239581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.243420 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.243352    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1d2f38-dockercfg-bxfb8\""
Jul 29 03:14:32.243646 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.243594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1d2f38\""
Jul 29 03:14:32.246543 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.246511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:14:32.291125 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.291083    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:14:32.294835 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.294807    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.304935 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.304898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:14:32.353308 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.353267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29x6\" (UniqueName: \"kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.353497 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.353315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.353497 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.353357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxsg\" (UniqueName: \"kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.353497 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.353395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.454397 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.454360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29x6\" (UniqueName: \"kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.454578 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.454404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.454578 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.454452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxsg\" (UniqueName: \"kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.454578 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.454495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.455332 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.455304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.455445 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.455369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.463767 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.463737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29x6\" (UniqueName: \"kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6\") pod \"payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") " pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.463922 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.463873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxsg\" (UniqueName: \"kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg\") pod \"payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.554482 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.554392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:32.607060 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.607021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:32.716664 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.716621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:14:32.720350 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:14:32.720304    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48fc239_019b_4fc0_afea_6f3803c6451f.slice/crio-c4e321b965ff864d89002c5746646307d9ab6c9e0e2f9ccd67633ce03c457151 WatchSource:0}: Error finding container c4e321b965ff864d89002c5746646307d9ab6c9e0e2f9ccd67633ce03c457151: Status 404 returned error can't find the container with id c4e321b965ff864d89002c5746646307d9ab6c9e0e2f9ccd67633ce03c457151
Jul 29 03:14:32.773070 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:32.773040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:14:32.775504 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:14:32.775477    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53de9c14_cd16_4ff6_93a6_dc1a46c1be7e.slice/crio-afb24b42384b758a6c49d15c2ce086cbeb878e1e6976529b9a9a78c4c33601cf WatchSource:0}: Error finding container afb24b42384b758a6c49d15c2ce086cbeb878e1e6976529b9a9a78c4c33601cf: Status 404 returned error can't find the container with id afb24b42384b758a6c49d15c2ce086cbeb878e1e6976529b9a9a78c4c33601cf
Jul 29 03:14:33.142469 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.142365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" event={"ID":"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e","Type":"ContainerStarted","Data":"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"}
Jul 29 03:14:33.142469 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.142419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" event={"ID":"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e","Type":"ContainerStarted","Data":"afb24b42384b758a6c49d15c2ce086cbeb878e1e6976529b9a9a78c4c33601cf"}
Jul 29 03:14:33.142469 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.142446    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:14:33.144194 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.144157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" event={"ID":"c48fc239-019b-4fc0-afea-6f3803c6451f","Type":"ContainerStarted","Data":"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"}
Jul 29 03:14:33.144367 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.144217    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:33.144367 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.144235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" event={"ID":"c48fc239-019b-4fc0-afea-6f3803c6451f","Type":"ContainerStarted","Data":"c4e321b965ff864d89002c5746646307d9ab6c9e0e2f9ccd67633ce03c457151"}
Jul 29 03:14:33.159256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.159188    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" podStartSLOduration=1.159169291 podStartE2EDuration="1.159169291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:14:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:14:33.156560618 +0000 UTC m=+2371.191277309" watchObservedRunningTime="2026-07-29 03:14:33.159169291 +0000 UTC m=+2371.193886053"
Jul 29 03:14:33.173790 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:33.173716    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" podStartSLOduration=1.173693203 podStartE2EDuration="1.173693203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:14:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:14:33.170695094 +0000 UTC m=+2371.205411801" watchObservedRunningTime="2026-07-29 03:14:33.173693203 +0000 UTC m=+2371.208409897"
Jul 29 03:14:44.152737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:44.152702    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:14:44.153159 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:14:44.152777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:15:00.130606 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.130563    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"]
Jul 29 03:15:00.134154 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.134134    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"]
Jul 29 03:15:00.134295 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.134275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"
Jul 29 03:15:00.136968 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.136937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:15:00.137822 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.137797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"
Jul 29 03:15:00.140982 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.140956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"]
Jul 29 03:15:00.144033 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.144009    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"]
Jul 29 03:15:00.148424 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.148400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"
Jul 29 03:15:00.157046 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.157022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"
Jul 29 03:15:00.306172 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.306144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"]
Jul 29 03:15:00.308723 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:00.308687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666d8606_04f0_445c_bd91_871a7a622abc.slice/crio-ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced WatchSource:0}: Error finding container ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced: Status 404 returned error can't find the container with id ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced
Jul 29 03:15:00.334154 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:00.334126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"]
Jul 29 03:15:00.336448 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:00.336409    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010c36ee_1402_47c1_95f3_05f2a4f8d802.slice/crio-fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191 WatchSource:0}: Error finding container fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191: Status 404 returned error can't find the container with id fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191
Jul 29 03:15:01.307022 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.306992    2560 generic.go:356] "Generic (PLEG): container finished" podID="010c36ee-1402-47c1-95f3-05f2a4f8d802" containerID="4b743513a84efb62738ba9fac68b31573a33671e1d815daedd6d9bdac46df01e" exitCode=0
Jul 29 03:15:01.307445 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.307085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6" event={"ID":"010c36ee-1402-47c1-95f3-05f2a4f8d802","Type":"ContainerDied","Data":"4b743513a84efb62738ba9fac68b31573a33671e1d815daedd6d9bdac46df01e"}
Jul 29 03:15:01.307445 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.307141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6" event={"ID":"010c36ee-1402-47c1-95f3-05f2a4f8d802","Type":"ContainerStarted","Data":"fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191"}
Jul 29 03:15:01.308830 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.308807    2560 generic.go:356] "Generic (PLEG): container finished" podID="666d8606-04f0-445c-bd91-871a7a622abc" containerID="94f82b23fd0cac3d7a25d4f5823bf8aa1de36d118950e8bde341f04b34069487" exitCode=0
Jul 29 03:15:01.308953 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.308843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc" event={"ID":"666d8606-04f0-445c-bd91-871a7a622abc","Type":"ContainerDied","Data":"94f82b23fd0cac3d7a25d4f5823bf8aa1de36d118950e8bde341f04b34069487"}
Jul 29 03:15:01.308953 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.308891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc" event={"ID":"666d8606-04f0-445c-bd91-871a7a622abc","Type":"ContainerStarted","Data":"ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced"}
Jul 29 03:15:01.355802 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.355759    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:15:01.359275 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.359255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.361878 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.361853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-bdd1b4-dockercfg-ck6zl\""
Jul 29 03:15:01.361878 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.361873    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-bdd1b4\""
Jul 29 03:15:01.363330 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.363308    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:15:01.366708 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.366684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.370374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.370345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:15:01.381680 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.381648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:15:01.421710 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.421665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.421710 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.421710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk8w4\" (UniqueName: \"kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.421934 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.421792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.421934 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.421836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kczk\" (UniqueName: \"kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.523237 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.523136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.523237 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.523208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk8w4\" (UniqueName: \"kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.523524 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.523335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.523524 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.523433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kczk\" (UniqueName: \"kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.524086 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.524065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.524124 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.524087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.532295 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.532266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kczk\" (UniqueName: \"kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk\") pod \"payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.532295 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.532290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk8w4\" (UniqueName: \"kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4\") pod \"payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") " pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.696533 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.696496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:01.703761 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.703732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:01.856403 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.856368    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:15:01.856601 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:01.856575    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7aa6ed_9d4f_4cd1_8da7_298a08a94e7e.slice/crio-cc475c3f82e3d7dd3df130dcd718526363bd42314a5eed8c7e6c58e4887a0842 WatchSource:0}: Error finding container cc475c3f82e3d7dd3df130dcd718526363bd42314a5eed8c7e6c58e4887a0842: Status 404 returned error can't find the container with id cc475c3f82e3d7dd3df130dcd718526363bd42314a5eed8c7e6c58e4887a0842
Jul 29 03:15:01.894231 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:01.894181    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4f90a7_ef69_4f43_9cf1_cee37fbd25a9.slice/crio-2278b32618ed1eecd2b2a3e621aa96074f726edf6027b155f6a01c2710eca8fe WatchSource:0}: Error finding container 2278b32618ed1eecd2b2a3e621aa96074f726edf6027b155f6a01c2710eca8fe: Status 404 returned error can't find the container with id 2278b32618ed1eecd2b2a3e621aa96074f726edf6027b155f6a01c2710eca8fe
Jul 29 03:15:01.894532 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:01.894508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:15:02.316803 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.316760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" event={"ID":"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9","Type":"ContainerStarted","Data":"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"}
Jul 29 03:15:02.317331 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.316824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" event={"ID":"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9","Type":"ContainerStarted","Data":"2278b32618ed1eecd2b2a3e621aa96074f726edf6027b155f6a01c2710eca8fe"}
Jul 29 03:15:02.317331 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.316899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:02.318552 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.318524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" event={"ID":"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e","Type":"ContainerStarted","Data":"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"}
Jul 29 03:15:02.318683 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.318572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" event={"ID":"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e","Type":"ContainerStarted","Data":"cc475c3f82e3d7dd3df130dcd718526363bd42314a5eed8c7e6c58e4887a0842"}
Jul 29 03:15:02.318683 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.318603    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:02.334302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.334232    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" podStartSLOduration=1.334214038 podStartE2EDuration="1.334214038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:15:02.331946548 +0000 UTC m=+2400.366663239" watchObservedRunningTime="2026-07-29 03:15:02.334214038 +0000 UTC m=+2400.368930728"
Jul 29 03:15:02.352175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.352112    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" podStartSLOduration=1.3520904040000001 podStartE2EDuration="1.352090404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:15:02.350237562 +0000 UTC m=+2400.384954253" watchObservedRunningTime="2026-07-29 03:15:02.352090404 +0000 UTC m=+2400.386807094"
Jul 29 03:15:02.473638 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.473607    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"
Jul 29 03:15:02.509458 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.509427    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"
Jul 29 03:15:02.732916 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.732883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:15:02.741043 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:02.741016    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:15:03.325834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.325802    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"
Jul 29 03:15:03.326302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.325832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6" event={"ID":"010c36ee-1402-47c1-95f3-05f2a4f8d802","Type":"ContainerDied","Data":"fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191"}
Jul 29 03:15:03.326302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.325880    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd344e6bc51947a3121b986dd0a151850b19cb1c3d428becbcf38bc9606bf191"
Jul 29 03:15:03.327278 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.327237    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc"
Jul 29 03:15:03.327394 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.327282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754915-47mxc" event={"ID":"666d8606-04f0-445c-bd91-871a7a622abc","Type":"ContainerDied","Data":"ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced"}
Jul 29 03:15:03.327394 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:03.327328    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceef2f2c80d4ab8ad06102e186cfd3480bbc9dd12d3697b6141411ad022e7ced"
Jul 29 03:15:13.329754 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:13.329717    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:15:13.330132 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:13.329833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:15:28.457829 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.457742    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"]
Jul 29 03:15:28.458273 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458228    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666d8606-04f0-445c-bd91-871a7a622abc" containerName="cleanup"
Jul 29 03:15:28.458319 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458274    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="666d8606-04f0-445c-bd91-871a7a622abc" containerName="cleanup"
Jul 29 03:15:28.458319 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458300    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010c36ee-1402-47c1-95f3-05f2a4f8d802" containerName="cleanup"
Jul 29 03:15:28.458319 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458306    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="010c36ee-1402-47c1-95f3-05f2a4f8d802" containerName="cleanup"
Jul 29 03:15:28.458432 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458368    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="010c36ee-1402-47c1-95f3-05f2a4f8d802" containerName="cleanup"
Jul 29 03:15:28.458432 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.458376    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="666d8606-04f0-445c-bd91-871a7a622abc" containerName="cleanup"
Jul 29 03:15:28.461595 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.461574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:28.464292 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.464267    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:15:28.464446 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.464268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:15:28.469263 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.469205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"]
Jul 29 03:15:28.559304 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.559226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf\" (UID: \"b9ddf6a9-07d9-444f-b234-083a58098504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:28.660751 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.660709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf\" (UID: \"b9ddf6a9-07d9-444f-b234-083a58098504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:28.661485 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.661467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf\" (UID: \"b9ddf6a9-07d9-444f-b234-083a58098504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:28.774490 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.774372    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:28.919036 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:28.919001    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"]
Jul 29 03:15:28.920589 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:28.920558    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ddf6a9_07d9_444f_b234_083a58098504.slice/crio-555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007 WatchSource:0}: Error finding container 555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007: Status 404 returned error can't find the container with id 555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007
Jul 29 03:15:29.477256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:29.477212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf" event={"ID":"b9ddf6a9-07d9-444f-b234-083a58098504","Type":"ContainerStarted","Data":"c7cc61c493c3384722bcfc72bcc3cccd251c691658d3853ad1e03d940fb87292"}
Jul 29 03:15:29.477681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:29.477313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf" event={"ID":"b9ddf6a9-07d9-444f-b234-083a58098504","Type":"ContainerStarted","Data":"555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007"}
Jul 29 03:15:29.491906 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:29.491853    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf" podStartSLOduration=1.491834609 podStartE2EDuration="1.491834609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:15:29.4913048 +0000 UTC m=+2427.526021489" watchObservedRunningTime="2026-07-29 03:15:29.491834609 +0000 UTC m=+2427.526551331"
Jul 29 03:15:30.484422 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:30.484384    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9ddf6a9-07d9-444f-b234-083a58098504" containerID="c7cc61c493c3384722bcfc72bcc3cccd251c691658d3853ad1e03d940fb87292" exitCode=0
Jul 29 03:15:30.484852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:30.484463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf" event={"ID":"b9ddf6a9-07d9-444f-b234-083a58098504","Type":"ContainerDied","Data":"c7cc61c493c3384722bcfc72bcc3cccd251c691658d3853ad1e03d940fb87292"}
Jul 29 03:15:31.639050 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:31.639021    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:31.791461 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:31.791351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca\") pod \"b9ddf6a9-07d9-444f-b234-083a58098504\" (UID: \"b9ddf6a9-07d9-444f-b234-083a58098504\") "
Jul 29 03:15:31.791801 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:31.791779    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b9ddf6a9-07d9-444f-b234-083a58098504" (UID: "b9ddf6a9-07d9-444f-b234-083a58098504"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:15:31.892902 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:31.892843    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ddf6a9-07d9-444f-b234-083a58098504-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:32.497555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:32.497521    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"
Jul 29 03:15:32.497738 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:32.497521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf" event={"ID":"b9ddf6a9-07d9-444f-b234-083a58098504","Type":"ContainerDied","Data":"555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007"}
Jul 29 03:15:32.497738 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:32.497649    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="555bd3673dd0710a573e4ffe2ea5174f909d3c6d71193e5c5aa2bc4334fdc007"
Jul 29 03:15:43.962376 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.962333    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"]
Jul 29 03:15:43.964720 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.964688    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1d2f38-29754915-xl4k6"]
Jul 29 03:15:43.991175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.991133    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:15:43.991501 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.991456    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerName="payload-processing" containerID="cri-o://8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8" gracePeriod=30
Jul 29 03:15:43.997554 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.997526    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:15:43.997851 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:43.997817    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerName="payload-pre-processing" containerID="cri-o://50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03" gracePeriod=30
Jul 29 03:15:44.131170 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.131130    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"]
Jul 29 03:15:44.136348 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.136311    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1d2f38-kk8rf"]
Jul 29 03:15:44.152766 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.152402    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.67:9004: connect: connection refused"
Jul 29 03:15:44.152957 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.152557    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.66:9004: connect: connection refused"
Jul 29 03:15:44.302375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.302342    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:15:44.305446 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.305423    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:15:44.408572 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.408537    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010c36ee-1402-47c1-95f3-05f2a4f8d802" path="/var/lib/kubelet/pods/010c36ee-1402-47c1-95f3-05f2a4f8d802/volumes"
Jul 29 03:15:44.408862 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.408849    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ddf6a9-07d9-444f-b234-083a58098504" path="/var/lib/kubelet/pods/b9ddf6a9-07d9-444f-b234-083a58098504/volumes"
Jul 29 03:15:44.410563 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.410532    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume\") pod \"c48fc239-019b-4fc0-afea-6f3803c6451f\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") "
Jul 29 03:15:44.410714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.410580    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skxsg\" (UniqueName: \"kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg\") pod \"c48fc239-019b-4fc0-afea-6f3803c6451f\" (UID: \"c48fc239-019b-4fc0-afea-6f3803c6451f\") "
Jul 29 03:15:44.410714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.410611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v29x6\" (UniqueName: \"kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6\") pod \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") "
Jul 29 03:15:44.410714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.410641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume\") pod \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\" (UID: \"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e\") "
Jul 29 03:15:44.411001 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.410934    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c48fc239-019b-4fc0-afea-6f3803c6451f" (UID: "c48fc239-019b-4fc0-afea-6f3803c6451f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:15:44.411137 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.411111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" (UID: "53de9c14-cd16-4ff6-93a6-dc1a46c1be7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:15:44.412737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.412715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6" (OuterVolumeSpecName: "kube-api-access-v29x6") pod "53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" (UID: "53de9c14-cd16-4ff6-93a6-dc1a46c1be7e"). InnerVolumeSpecName "kube-api-access-v29x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:15:44.413076 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.413057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg" (OuterVolumeSpecName: "kube-api-access-skxsg") pod "c48fc239-019b-4fc0-afea-6f3803c6451f" (UID: "c48fc239-019b-4fc0-afea-6f3803c6451f"). InnerVolumeSpecName "kube-api-access-skxsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:15:44.512645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.512597    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c48fc239-019b-4fc0-afea-6f3803c6451f-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:44.512645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.512636    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skxsg\" (UniqueName: \"kubernetes.io/projected/c48fc239-019b-4fc0-afea-6f3803c6451f-kube-api-access-skxsg\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:44.512645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.512649    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v29x6\" (UniqueName: \"kubernetes.io/projected/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-kube-api-access-v29x6\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:44.512645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.512660    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:44.569134 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.569043    2560 generic.go:356] "Generic (PLEG): container finished" podID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerID="8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8" exitCode=0
Jul 29 03:15:44.569134 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.569085    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"
Jul 29 03:15:44.569416 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.569130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" event={"ID":"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e","Type":"ContainerDied","Data":"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"}
Jul 29 03:15:44.569416 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.569187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm" event={"ID":"53de9c14-cd16-4ff6-93a6-dc1a46c1be7e","Type":"ContainerDied","Data":"afb24b42384b758a6c49d15c2ce086cbeb878e1e6976529b9a9a78c4c33601cf"}
Jul 29 03:15:44.569416 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.569216    2560 scope.go:117] "RemoveContainer" containerID="8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"
Jul 29 03:15:44.570536 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.570512    2560 generic.go:356] "Generic (PLEG): container finished" podID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerID="50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03" exitCode=0
Jul 29 03:15:44.570643 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.570548    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"
Jul 29 03:15:44.570643 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.570605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" event={"ID":"c48fc239-019b-4fc0-afea-6f3803c6451f","Type":"ContainerDied","Data":"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"}
Jul 29 03:15:44.570730 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.570650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp" event={"ID":"c48fc239-019b-4fc0-afea-6f3803c6451f","Type":"ContainerDied","Data":"c4e321b965ff864d89002c5746646307d9ab6c9e0e2f9ccd67633ce03c457151"}
Jul 29 03:15:44.579437 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.579412    2560 scope.go:117] "RemoveContainer" containerID="8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"
Jul 29 03:15:44.579805 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:15:44.579786    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8\": container with ID starting with 8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8 not found: ID does not exist" containerID="8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"
Jul 29 03:15:44.579894 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.579814    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8"} err="failed to get container status \"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8\": rpc error: code = NotFound desc = could not find container \"8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8\": container with ID starting with 8ea64369dd27e5500cc93bf7f5ecc29a737b94c631ddf793f25eae65455f62b8 not found: ID does not exist"
Jul 29 03:15:44.579894 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.579833    2560 scope.go:117] "RemoveContainer" containerID="50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"
Jul 29 03:15:44.592010 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.591980    2560 scope.go:117] "RemoveContainer" containerID="50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"
Jul 29 03:15:44.592411 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:15:44.592384    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03\": container with ID starting with 50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03 not found: ID does not exist" containerID="50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"
Jul 29 03:15:44.592555 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.592418    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03"} err="failed to get container status \"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03\": rpc error: code = NotFound desc = could not find container \"50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03\": container with ID starting with 50549355e5bc7a6b90dce4107dacbd4f0e248b6d41bf5384611bd6147f453b03 not found: ID does not exist"
Jul 29 03:15:44.595681 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.595652    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:15:44.602673 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.602646    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1d2f38-699f8cbddd-csxqm"]
Jul 29 03:15:44.615323 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.615289    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:15:44.618885 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:44.618852    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2f38-6d689775b4-xxvlp"]
Jul 29 03:15:46.408185 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:46.408148    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" path="/var/lib/kubelet/pods/53de9c14-cd16-4ff6-93a6-dc1a46c1be7e/volumes"
Jul 29 03:15:46.408590 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:46.408551    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" path="/var/lib/kubelet/pods/c48fc239-019b-4fc0-afea-6f3803c6451f/volumes"
Jul 29 03:15:50.805035 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805000    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"]
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805361    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerName="payload-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805373    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerName="payload-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805394    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ddf6a9-07d9-444f-b234-083a58098504" containerName="revoke-keys"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805399    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ddf6a9-07d9-444f-b234-083a58098504" containerName="revoke-keys"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805408    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerName="payload-pre-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805414    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerName="payload-pre-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805474    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="53de9c14-cd16-4ff6-93a6-dc1a46c1be7e" containerName="payload-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805483    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48fc239-019b-4fc0-afea-6f3803c6451f" containerName="payload-pre-processing"
Jul 29 03:15:50.805486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.805489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ddf6a9-07d9-444f-b234-083a58098504" containerName="revoke-keys"
Jul 29 03:15:50.809888 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.809868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:50.813394 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.813358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:15:50.813553 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.813359    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:15:50.815510 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.815480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"]
Jul 29 03:15:50.871760 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.871708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf\" (UID: \"089e0a6c-c748-48e0-877a-f5fbdbba13ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:50.972737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.972699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf\" (UID: \"089e0a6c-c748-48e0-877a-f5fbdbba13ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:50.973457 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:50.973432    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf\" (UID: \"089e0a6c-c748-48e0-877a-f5fbdbba13ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:51.122639 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:51.122525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:51.266103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:51.266068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"]
Jul 29 03:15:51.267593 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:15:51.267567    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089e0a6c_c748_48e0_877a_f5fbdbba13ca.slice/crio-7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0 WatchSource:0}: Error finding container 7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0: Status 404 returned error can't find the container with id 7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0
Jul 29 03:15:51.612841 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:51.612801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf" event={"ID":"089e0a6c-c748-48e0-877a-f5fbdbba13ca","Type":"ContainerStarted","Data":"ebe4076ea812a601a71b8ccd62379d464aafd46d403a5c9d2846a67062b00b02"}
Jul 29 03:15:51.613000 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:51.612864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf" event={"ID":"089e0a6c-c748-48e0-877a-f5fbdbba13ca","Type":"ContainerStarted","Data":"7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0"}
Jul 29 03:15:51.636307 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:51.636232    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf" podStartSLOduration=1.63621277 podStartE2EDuration="1.63621277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:15:51.63482271 +0000 UTC m=+2449.669539401" watchObservedRunningTime="2026-07-29 03:15:51.63621277 +0000 UTC m=+2449.670929461"
Jul 29 03:15:52.620548 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:52.620509    2560 generic.go:356] "Generic (PLEG): container finished" podID="089e0a6c-c748-48e0-877a-f5fbdbba13ca" containerID="ebe4076ea812a601a71b8ccd62379d464aafd46d403a5c9d2846a67062b00b02" exitCode=0
Jul 29 03:15:52.620954 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:52.620591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf" event={"ID":"089e0a6c-c748-48e0-877a-f5fbdbba13ca","Type":"ContainerDied","Data":"ebe4076ea812a601a71b8ccd62379d464aafd46d403a5c9d2846a67062b00b02"}
Jul 29 03:15:53.767307 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:53.767272    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:53.798313 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:53.798282    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca\") pod \"089e0a6c-c748-48e0-877a-f5fbdbba13ca\" (UID: \"089e0a6c-c748-48e0-877a-f5fbdbba13ca\") "
Jul 29 03:15:53.798645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:53.798623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "089e0a6c-c748-48e0-877a-f5fbdbba13ca" (UID: "089e0a6c-c748-48e0-877a-f5fbdbba13ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:15:53.899377 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:53.899291    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/089e0a6c-c748-48e0-877a-f5fbdbba13ca-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:15:54.633631 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:54.633591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf" event={"ID":"089e0a6c-c748-48e0-877a-f5fbdbba13ca","Type":"ContainerDied","Data":"7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0"}
Jul 29 03:15:54.633631 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:54.633621    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"
Jul 29 03:15:54.633857 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:15:54.633655    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e191f43890c9bb737ac35f84f57d58cbc364975f48291fc6df25db4a16ba0b0"
Jul 29 03:16:02.874662 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:02.874628    2560 scope.go:117] "RemoveContainer" containerID="aaf3bc4d2261b79a16469f44d0c6494eab8063d3c3bd1971a9d5e20de07bd985"
Jul 29 03:16:06.396522 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.396485    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:16:06.397001 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.396702    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" podUID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" containerName="payload-processing" containerID="cri-o://4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2" gracePeriod=30
Jul 29 03:16:06.413701 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.413666    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:16:06.413978 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.413933    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" podUID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" containerName="payload-pre-processing" containerID="cri-o://949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737" gracePeriod=30
Jul 29 03:16:06.545766 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.545711    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"]
Jul 29 03:16:06.549501 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.549457    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bdd1b4-q4bgf"]
Jul 29 03:16:06.700646 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.700623    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:16:06.703398 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.703378    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:16:06.706988 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.706965    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" containerID="4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2" exitCode=0
Jul 29 03:16:06.707106 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.707004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"
Jul 29 03:16:06.707106 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.707036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" event={"ID":"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9","Type":"ContainerDied","Data":"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"}
Jul 29 03:16:06.707221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.707112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l" event={"ID":"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9","Type":"ContainerDied","Data":"2278b32618ed1eecd2b2a3e621aa96074f726edf6027b155f6a01c2710eca8fe"}
Jul 29 03:16:06.707221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.707141    2560 scope.go:117] "RemoveContainer" containerID="4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"
Jul 29 03:16:06.708466 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.708439    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" containerID="949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737" exitCode=0
Jul 29 03:16:06.708565 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.708474    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"
Jul 29 03:16:06.708565 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.708503    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" event={"ID":"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e","Type":"ContainerDied","Data":"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"}
Jul 29 03:16:06.708565 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.708555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl" event={"ID":"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e","Type":"ContainerDied","Data":"cc475c3f82e3d7dd3df130dcd718526363bd42314a5eed8c7e6c58e4887a0842"}
Jul 29 03:16:06.716193 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.716168    2560 scope.go:117] "RemoveContainer" containerID="4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"
Jul 29 03:16:06.716533 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:16:06.716514    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2\": container with ID starting with 4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2 not found: ID does not exist" containerID="4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"
Jul 29 03:16:06.716583 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.716542    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2"} err="failed to get container status \"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2\": rpc error: code = NotFound desc = could not find container \"4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2\": container with ID starting with 4883d4af2794fed65ad877672eb4663a89a4db573baf81a07c84f136394e9ff2 not found: ID does not exist"
Jul 29 03:16:06.716583 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.716562    2560 scope.go:117] "RemoveContainer" containerID="949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"
Jul 29 03:16:06.729056 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.729036    2560 scope.go:117] "RemoveContainer" containerID="949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"
Jul 29 03:16:06.729418 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:16:06.729395    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737\": container with ID starting with 949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737 not found: ID does not exist" containerID="949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"
Jul 29 03:16:06.729489 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.729428    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737"} err="failed to get container status \"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737\": rpc error: code = NotFound desc = could not find container \"949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737\": container with ID starting with 949ffa5eeebb3eb494f3cb83d5516076f769b78dcd19863081761fedbd0b2737 not found: ID does not exist"
Jul 29 03:16:06.810600 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.810559    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume\") pod \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") "
Jul 29 03:16:06.810779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.810624    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kczk\" (UniqueName: \"kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk\") pod \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") "
Jul 29 03:16:06.810779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.810654    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk8w4\" (UniqueName: \"kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4\") pod \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\" (UID: \"ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9\") "
Jul 29 03:16:06.810779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.810728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume\") pod \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\" (UID: \"7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e\") "
Jul 29 03:16:06.811003 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.810974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" (UID: "ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:16:06.811204 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.811180    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" (UID: "7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:16:06.812923 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.812900    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk" (OuterVolumeSpecName: "kube-api-access-7kczk") pod "7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" (UID: "7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e"). InnerVolumeSpecName "kube-api-access-7kczk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:16:06.812923 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.812916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4" (OuterVolumeSpecName: "kube-api-access-tk8w4") pod "ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" (UID: "ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9"). InnerVolumeSpecName "kube-api-access-tk8w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:16:06.911559 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.911515    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:16:06.911559 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.911550    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:16:06.911559 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.911562    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kczk\" (UniqueName: \"kubernetes.io/projected/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e-kube-api-access-7kczk\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:16:06.911559 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:06.911574    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk8w4\" (UniqueName: \"kubernetes.io/projected/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9-kube-api-access-tk8w4\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:16:07.030302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:07.030262    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:16:07.034580 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:07.034553    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bdd1b4-74f56d9796-xh88l"]
Jul 29 03:16:07.045323 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:07.045289    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:16:07.047443 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:07.047422    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bdd1b4-5576d5f5d4-4fstl"]
Jul 29 03:16:08.409776 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:08.409729    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="089e0a6c-c748-48e0-877a-f5fbdbba13ca" path="/var/lib/kubelet/pods/089e0a6c-c748-48e0-877a-f5fbdbba13ca/volumes"
Jul 29 03:16:08.410174 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:08.410162    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" path="/var/lib/kubelet/pods/7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e/volumes"
Jul 29 03:16:08.410572 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:08.410553    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" path="/var/lib/kubelet/pods/ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9/volumes"
Jul 29 03:16:17.632146 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632497    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" containerName="payload-pre-processing"
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632510    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" containerName="payload-pre-processing"
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632524    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="089e0a6c-c748-48e0-877a-f5fbdbba13ca" containerName="revoke-keys"
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632530    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="089e0a6c-c748-48e0-877a-f5fbdbba13ca" containerName="revoke-keys"
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632536    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" containerName="payload-processing"
Jul 29 03:16:17.632560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632542    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" containerName="payload-processing"
Jul 29 03:16:17.632798 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632598    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef4f90a7-ef69-4f43-9cf1-cee37fbd25a9" containerName="payload-processing"
Jul 29 03:16:17.632798 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632607    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="089e0a6c-c748-48e0-877a-f5fbdbba13ca" containerName="revoke-keys"
Jul 29 03:16:17.632798 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.632614    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7aa6ed-9d4f-4cd1-8da7-298a08a94e7e" containerName="payload-pre-processing"
Jul 29 03:16:17.635699 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.635681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.639367 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.639343    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-f4870d-dockercfg-9gcbf\""
Jul 29 03:16:17.639497 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.639447    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-f4870d\""
Jul 29 03:16:17.650030 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.649996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:16:17.660807 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.660775    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:16:17.664330 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.664304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.678398 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.678368    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:16:17.711047 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.711006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8gq7\" (UniqueName: \"kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.711227 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.711164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.811876 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.811832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.811876 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.811882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8gq7\" (UniqueName: \"kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.812134 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.811939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.812134 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.811964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj4cd\" (UniqueName: \"kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.812718 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.812697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.820302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.820241    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8gq7\" (UniqueName: \"kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7\") pod \"payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.913297 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.913164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj4cd\" (UniqueName: \"kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.913488 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.913330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.914031 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.914007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.921795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.921765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj4cd\" (UniqueName: \"kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd\") pod \"payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:17.946644 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.946603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:17.976322 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:17.976276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:18.106339 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.102977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:16:18.108061 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:16:18.108024    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51ae385_d29c_4820_8b86_57dfd694344a.slice/crio-9b2e567cfc76df1c78fe3d133dabf9363be4258aeb2da0d92fa277c6eeaf6cdd WatchSource:0}: Error finding container 9b2e567cfc76df1c78fe3d133dabf9363be4258aeb2da0d92fa277c6eeaf6cdd: Status 404 returned error can't find the container with id 9b2e567cfc76df1c78fe3d133dabf9363be4258aeb2da0d92fa277c6eeaf6cdd
Jul 29 03:16:18.136561 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.136530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:16:18.138765 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:16:18.138730    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac30b71_7337_42a4_a776_94ed6b873042.slice/crio-c46293b054d129566004d8bc6ae756dbec4717811bf5f470a9fb70df0a604cc9 WatchSource:0}: Error finding container c46293b054d129566004d8bc6ae756dbec4717811bf5f470a9fb70df0a604cc9: Status 404 returned error can't find the container with id c46293b054d129566004d8bc6ae756dbec4717811bf5f470a9fb70df0a604cc9
Jul 29 03:16:18.783552 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.783512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" event={"ID":"c51ae385-d29c-4820-8b86-57dfd694344a","Type":"ContainerStarted","Data":"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"}
Jul 29 03:16:18.784062 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.783586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:18.784062 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.783608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" event={"ID":"c51ae385-d29c-4820-8b86-57dfd694344a","Type":"ContainerStarted","Data":"9b2e567cfc76df1c78fe3d133dabf9363be4258aeb2da0d92fa277c6eeaf6cdd"}
Jul 29 03:16:18.786058 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.786020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" event={"ID":"aac30b71-7337-42a4-a776-94ed6b873042","Type":"ContainerStarted","Data":"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"}
Jul 29 03:16:18.786216 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.786084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:18.786216 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.786105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" event={"ID":"aac30b71-7337-42a4-a776-94ed6b873042","Type":"ContainerStarted","Data":"c46293b054d129566004d8bc6ae756dbec4717811bf5f470a9fb70df0a604cc9"}
Jul 29 03:16:18.801808 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.801756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" podStartSLOduration=1.801739596 podStartE2EDuration="1.801739596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:16:18.799538016 +0000 UTC m=+2476.834254707" watchObservedRunningTime="2026-07-29 03:16:18.801739596 +0000 UTC m=+2476.836456286"
Jul 29 03:16:18.815488 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:18.815432    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" podStartSLOduration=1.815414101 podStartE2EDuration="1.815414101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:16:18.814716787 +0000 UTC m=+2476.849433478" watchObservedRunningTime="2026-07-29 03:16:18.815414101 +0000 UTC m=+2476.850130791"
Jul 29 03:16:29.796331 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:29.796293    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:16:29.796749 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:29.796389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:16:45.936147 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.936106    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:16:45.939632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.939612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:45.942409 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.942382    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-19184d\""
Jul 29 03:16:45.942560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.942487    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-19184d-dockercfg-v5wqq\""
Jul 29 03:16:45.950996 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.950963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:16:45.964196 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.964155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:45.964452 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.964215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dj67\" (UniqueName: \"kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:45.971221 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.971187    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:16:45.974730 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.974705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:45.994542 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:45.994509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:16:46.065092 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.065048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.065320 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.065170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvqs\" (UniqueName: \"kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.065320 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.065216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.065320 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.065268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dj67\" (UniqueName: \"kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.065993 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.065973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.073791 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.073758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dj67\" (UniqueName: \"kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67\") pod \"payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.165987 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.165945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvqs\" (UniqueName: \"kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.166184 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.166021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.166794 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.166774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.174810 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.174775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvqs\" (UniqueName: \"kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs\") pod \"payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") " pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.253480 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.253368    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.285182 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.285143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.416968 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.416915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:16:46.419299 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:16:46.419262    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce45a6f_bc50_4a6d_bc51_e99cb9d36c98.slice/crio-f2327191f88fff8a5c286b1b2c97ab1374a6028581d01988a3446885d8052d89 WatchSource:0}: Error finding container f2327191f88fff8a5c286b1b2c97ab1374a6028581d01988a3446885d8052d89: Status 404 returned error can't find the container with id f2327191f88fff8a5c286b1b2c97ab1374a6028581d01988a3446885d8052d89
Jul 29 03:16:46.445158 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.445125    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:16:46.465075 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:16:46.462011    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fc0651_fcda_447d_adc5_5a2a36e75013.slice/crio-5c369c42ebd53f75bad2dc2e5c697fadf9b62e091f226fae7e937874b4bb77b1 WatchSource:0}: Error finding container 5c369c42ebd53f75bad2dc2e5c697fadf9b62e091f226fae7e937874b4bb77b1: Status 404 returned error can't find the container with id 5c369c42ebd53f75bad2dc2e5c697fadf9b62e091f226fae7e937874b4bb77b1
Jul 29 03:16:46.954962 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.954925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" event={"ID":"80fc0651-fcda-447d-adc5-5a2a36e75013","Type":"ContainerStarted","Data":"76bf1c4647bce781019bbb5857c4ef3f7ee6877e22b9f1b3be2cd53bb1fed8ec"}
Jul 29 03:16:46.955454 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.954990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" event={"ID":"80fc0651-fcda-447d-adc5-5a2a36e75013","Type":"ContainerStarted","Data":"5c369c42ebd53f75bad2dc2e5c697fadf9b62e091f226fae7e937874b4bb77b1"}
Jul 29 03:16:46.955454 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.955022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:46.956649 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.956620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" event={"ID":"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98","Type":"ContainerStarted","Data":"429e32c38b748064446481262ddb144ecda7d38b25ec2c50cabc69dd17af9a80"}
Jul 29 03:16:46.956752 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.956667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" event={"ID":"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98","Type":"ContainerStarted","Data":"f2327191f88fff8a5c286b1b2c97ab1374a6028581d01988a3446885d8052d89"}
Jul 29 03:16:46.956752 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.956688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:16:46.972861 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.972792    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" podStartSLOduration=1.9727701899999999 podStartE2EDuration="1.97277019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:16:46.970095439 +0000 UTC m=+2505.004812152" watchObservedRunningTime="2026-07-29 03:16:46.97277019 +0000 UTC m=+2505.007486885"
Jul 29 03:16:46.985084 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:46.985013    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" podStartSLOduration=1.9849922150000001 podStartE2EDuration="1.984992215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:16:46.984329004 +0000 UTC m=+2505.019045696" watchObservedRunningTime="2026-07-29 03:16:46.984992215 +0000 UTC m=+2505.019708905"
Jul 29 03:16:57.964334 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:57.964237    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:16:57.964723 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:16:57.964450    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:20:02.771377 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:20:02.771300    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:20:02.781589 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:20:02.781560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:20:02.944203 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:20:02.944169    2560 scope.go:117] "RemoveContainer" containerID="86a451d35a527084221fec16c8f50056227fd0ae0116e79b80c3b72acfc042c2"
Jul 29 03:21:02.967158 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:21:02.967122    2560 scope.go:117] "RemoveContainer" containerID="4b743513a84efb62738ba9fac68b31573a33671e1d815daedd6d9bdac46df01e"
Jul 29 03:21:02.976597 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:21:02.976565    2560 scope.go:117] "RemoveContainer" containerID="60e171728b190f6a2f0291bda2c5e39edbc34590f52bef3bcbc20a68e2aab716"
Jul 29 03:22:03.003825 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:22:03.003789    2560 scope.go:117] "RemoveContainer" containerID="c7cc61c493c3384722bcfc72bcc3cccd251c691658d3853ad1e03d940fb87292"
Jul 29 03:22:03.012897 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:22:03.012868    2560 scope.go:117] "RemoveContainer" containerID="ebe4076ea812a601a71b8ccd62379d464aafd46d403a5c9d2846a67062b00b02"
Jul 29 03:25:02.807282 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:02.807143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:25:02.825284 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:02.825234    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:25:52.853865 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:52.853831    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:52.857532 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:52.857510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:52.859976 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:52.859954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d68hw\""
Jul 29 03:25:52.865664 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:52.865635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:52.980715 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:52.980674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqxnt\" (UniqueName: \"kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt\") pod \"test-curl-7649-140571252955152\" (UID: \"759efffd-5a0c-4366-8070-9e7121f2ed21\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:53.081636 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:53.081593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqxnt\" (UniqueName: \"kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt\") pod \"test-curl-7649-140571252955152\" (UID: \"759efffd-5a0c-4366-8070-9e7121f2ed21\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:53.092055 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:53.092019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqxnt\" (UniqueName: \"kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt\") pod \"test-curl-7649-140571252955152\" (UID: \"759efffd-5a0c-4366-8070-9e7121f2ed21\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:53.168092 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:53.168000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:53.307583 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:53.307555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:53.309360 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:25:53.309327    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod759efffd_5a0c_4366_8070_9e7121f2ed21.slice/crio-0e0d8f56ee9f6bac69db5259f307e3f2996986d805a9f9b523ad6470b2ebc240 WatchSource:0}: Error finding container 0e0d8f56ee9f6bac69db5259f307e3f2996986d805a9f9b523ad6470b2ebc240: Status 404 returned error can't find the container with id 0e0d8f56ee9f6bac69db5259f307e3f2996986d805a9f9b523ad6470b2ebc240
Jul 29 03:25:53.310824 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:53.310802    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 03:25:54.026046 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:54.026013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252955152" event={"ID":"759efffd-5a0c-4366-8070-9e7121f2ed21","Type":"ContainerStarted","Data":"0e0d8f56ee9f6bac69db5259f307e3f2996986d805a9f9b523ad6470b2ebc240"}
Jul 29 03:25:55.034095 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:55.034057    2560 generic.go:356] "Generic (PLEG): container finished" podID="759efffd-5a0c-4366-8070-9e7121f2ed21" containerID="6bdbdb17b9cf1a69724d5033e397c6e1ea101448383aa032750abd77771c82d9" exitCode=0
Jul 29 03:25:55.034531 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:55.034137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252955152" event={"ID":"759efffd-5a0c-4366-8070-9e7121f2ed21","Type":"ContainerDied","Data":"6bdbdb17b9cf1a69724d5033e397c6e1ea101448383aa032750abd77771c82d9"}
Jul 29 03:25:56.183203 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.183179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.207481 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.207457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqxnt\" (UniqueName: \"kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt\") pod \"759efffd-5a0c-4366-8070-9e7121f2ed21\" (UID: \"759efffd-5a0c-4366-8070-9e7121f2ed21\") "
Jul 29 03:25:56.209531 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.209502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt" (OuterVolumeSpecName: "kube-api-access-wqxnt") pod "759efffd-5a0c-4366-8070-9e7121f2ed21" (UID: "759efffd-5a0c-4366-8070-9e7121f2ed21"). InnerVolumeSpecName "kube-api-access-wqxnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:25:56.220214 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.220190    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7649-140571252955152_759efffd-5a0c-4366-8070-9e7121f2ed21/test-curl-7649-140571252955152/0.log"
Jul 29 03:25:56.244208 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.244172    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:56.247844 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.247808    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:56.308103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.308024    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqxnt\" (UniqueName: \"kubernetes.io/projected/759efffd-5a0c-4366-8070-9e7121f2ed21-kube-api-access-wqxnt\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:25:56.369492 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.369453    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:56.369895 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.369880    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759efffd-5a0c-4366-8070-9e7121f2ed21" containerName="test-curl-7649-140571252955152"
Jul 29 03:25:56.369936 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.369897    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="759efffd-5a0c-4366-8070-9e7121f2ed21" containerName="test-curl-7649-140571252955152"
Jul 29 03:25:56.369978 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.369968    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="759efffd-5a0c-4366-8070-9e7121f2ed21" containerName="test-curl-7649-140571252955152"
Jul 29 03:25:56.373074 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.373057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.379217 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.379184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:56.408014 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.407979    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="759efffd-5a0c-4366-8070-9e7121f2ed21" path="/var/lib/kubelet/pods/759efffd-5a0c-4366-8070-9e7121f2ed21/volumes"
Jul 29 03:25:56.408347 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.408329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmjp\" (UniqueName: \"kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp\") pod \"test-curl-7649-140571252955152\" (UID: \"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.509697 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.509656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmjp\" (UniqueName: \"kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp\") pod \"test-curl-7649-140571252955152\" (UID: \"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.519151 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.519119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmjp\" (UniqueName: \"kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp\") pod \"test-curl-7649-140571252955152\" (UID: \"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75\") " pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.683117 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.683082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:56.822753 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:56.822722    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:56.823845 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:25:56.823819    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c06fbb2_79a8_4a99_9431_5e3f4ef95c75.slice/crio-6099a1f426a0dff56994ad5b9f1d9fe2daa6c10a137bc15a85101088deb9a311 WatchSource:0}: Error finding container 6099a1f426a0dff56994ad5b9f1d9fe2daa6c10a137bc15a85101088deb9a311: Status 404 returned error can't find the container with id 6099a1f426a0dff56994ad5b9f1d9fe2daa6c10a137bc15a85101088deb9a311
Jul 29 03:25:57.046624 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:57.046535    2560 scope.go:117] "RemoveContainer" containerID="6bdbdb17b9cf1a69724d5033e397c6e1ea101448383aa032750abd77771c82d9"
Jul 29 03:25:57.046624 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:57.046552    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:57.048099 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:57.047910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252955152" event={"ID":"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75","Type":"ContainerStarted","Data":"6099a1f426a0dff56994ad5b9f1d9fe2daa6c10a137bc15a85101088deb9a311"}
Jul 29 03:25:58.056515 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:58.056476    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" containerID="a8925c0cfbedf8e872baa45c5ef9f26fee11f1f103acddf99eb16656c125abd2" exitCode=0
Jul 29 03:25:58.056906 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:58.056558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252955152" event={"ID":"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75","Type":"ContainerDied","Data":"a8925c0cfbedf8e872baa45c5ef9f26fee11f1f103acddf99eb16656c125abd2"}
Jul 29 03:25:59.206760 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.206733    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:25:59.227186 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.227149    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7649-140571252955152_3c06fbb2-79a8-4a99-9431-5e3f4ef95c75/test-curl-7649-140571252955152/0.log"
Jul 29 03:25:59.236424 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.236381    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzmjp\" (UniqueName: \"kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp\") pod \"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75\" (UID: \"3c06fbb2-79a8-4a99-9431-5e3f4ef95c75\") "
Jul 29 03:25:59.238461 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.238434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp" (OuterVolumeSpecName: "kube-api-access-dzmjp") pod "3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" (UID: "3c06fbb2-79a8-4a99-9431-5e3f4ef95c75"). InnerVolumeSpecName "kube-api-access-dzmjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:25:59.250604 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.250574    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:59.253723 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.253695    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7649-140571252955152"]
Jul 29 03:25:59.337792 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:25:59.337682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzmjp\" (UniqueName: \"kubernetes.io/projected/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75-kube-api-access-dzmjp\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.069654 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:00.069629    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:26:00.070039 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:00.069674    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6099a1f426a0dff56994ad5b9f1d9fe2daa6c10a137bc15a85101088deb9a311"
Jul 29 03:26:00.080517 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:26:00.080485    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7649-140571252955152\" is forbidden: User \"system:node:ip-10-0-133-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-22.ec2.internal' and this object" podUID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" pod="opendatahub/test-curl-7649-140571252955152"
Jul 29 03:26:00.409129 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:00.409032    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" path="/var/lib/kubelet/pods/3c06fbb2-79a8-4a99-9431-5e3f4ef95c75/volumes"
Jul 29 03:26:09.638596 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.638558    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:26:09.638992 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.638932    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" containerName="test-curl-7649-140571252955152"
Jul 29 03:26:09.638992 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.638945    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" containerName="test-curl-7649-140571252955152"
Jul 29 03:26:09.639069 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.639018    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c06fbb2-79a8-4a99-9431-5e3f4ef95c75" containerName="test-curl-7649-140571252955152"
Jul 29 03:26:09.643597 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.643569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.646131 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.646108    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bf2f02\""
Jul 29 03:26:09.646477 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.646452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bf2f02-dockercfg-sfwjc\""
Jul 29 03:26:09.655965 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.655938    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:26:09.675928 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.675893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:26:09.679392 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.679374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.690486 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.690450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:26:09.733054 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.733017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpq5\" (UniqueName: \"kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.733266 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.733077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.733266 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.733142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.733266 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.733176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprj2\" (UniqueName: \"kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.834554 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.834496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpq5\" (UniqueName: \"kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.834779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.834569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.834779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.834610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.834779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.834638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprj2\" (UniqueName: \"kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.835303 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.835283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.835357 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.835331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.843571 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.843545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpq5\" (UniqueName: \"kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5\") pod \"payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:09.843919 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.843899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprj2\" (UniqueName: \"kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2\") pod \"payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.954690 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.954654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:09.990962 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:09.990914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:10.315101 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:10.315068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:26:10.316835 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:26:10.316796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d00100_580f_4040_9bd2_a0c5e97b044c.slice/crio-da33a9d8732207f6a3d4982ee383a3af9a27c7c93041985f3bed15891b38e240 WatchSource:0}: Error finding container da33a9d8732207f6a3d4982ee383a3af9a27c7c93041985f3bed15891b38e240: Status 404 returned error can't find the container with id da33a9d8732207f6a3d4982ee383a3af9a27c7c93041985f3bed15891b38e240
Jul 29 03:26:10.355611 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:10.355580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:26:10.355866 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:26:10.355845    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e077441_dde9_4d3a_834b_0ab7aeee01b2.slice/crio-6214e2f4d3e9a5232990543a6d0ca1074158e6dfbf4f621c2023da0787145fc6 WatchSource:0}: Error finding container 6214e2f4d3e9a5232990543a6d0ca1074158e6dfbf4f621c2023da0787145fc6: Status 404 returned error can't find the container with id 6214e2f4d3e9a5232990543a6d0ca1074158e6dfbf4f621c2023da0787145fc6
Jul 29 03:26:11.139354 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.139317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" event={"ID":"2e077441-dde9-4d3a-834b-0ab7aeee01b2","Type":"ContainerStarted","Data":"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"}
Jul 29 03:26:11.139817 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.139382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" event={"ID":"2e077441-dde9-4d3a-834b-0ab7aeee01b2","Type":"ContainerStarted","Data":"6214e2f4d3e9a5232990543a6d0ca1074158e6dfbf4f621c2023da0787145fc6"}
Jul 29 03:26:11.139817 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.139500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:11.141047 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.141021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" event={"ID":"b2d00100-580f-4040-9bd2-a0c5e97b044c","Type":"ContainerStarted","Data":"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"}
Jul 29 03:26:11.141178 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.141070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" event={"ID":"b2d00100-580f-4040-9bd2-a0c5e97b044c","Type":"ContainerStarted","Data":"da33a9d8732207f6a3d4982ee383a3af9a27c7c93041985f3bed15891b38e240"}
Jul 29 03:26:11.141178 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.141099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:11.157112 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.157060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" podStartSLOduration=2.157041812 podStartE2EDuration="2.157041812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:11.155520164 +0000 UTC m=+3069.190236856" watchObservedRunningTime="2026-07-29 03:26:11.157041812 +0000 UTC m=+3069.191758480"
Jul 29 03:26:11.175256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:11.175185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" podStartSLOduration=2.175163017 podStartE2EDuration="2.175163017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:11.171648515 +0000 UTC m=+3069.206365225" watchObservedRunningTime="2026-07-29 03:26:11.175163017 +0000 UTC m=+3069.209879709"
Jul 29 03:26:22.150120 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:22.150087    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:26:22.150726 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:22.150163    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:26:38.044430 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.044390    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:38.049633 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.049613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:38.052374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.052348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gbb5t\""
Jul 29 03:26:38.056810 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.056781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:38.192833 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.192786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stv4v\" (UniqueName: \"kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v\") pod \"kuadrant-operator-catalog-lf8wc\" (UID: \"744ea1a3-c77a-45c8-bd31-81784cbfbbd1\") " pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:38.293734 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.293695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stv4v\" (UniqueName: \"kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v\") pod \"kuadrant-operator-catalog-lf8wc\" (UID: \"744ea1a3-c77a-45c8-bd31-81784cbfbbd1\") " pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:38.303145 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.303084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stv4v\" (UniqueName: \"kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v\") pod \"kuadrant-operator-catalog-lf8wc\" (UID: \"744ea1a3-c77a-45c8-bd31-81784cbfbbd1\") " pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:38.360883 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.360834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:38.502143 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:38.502114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:38.503844 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:26:38.503820    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744ea1a3_c77a_45c8_bd31_81784cbfbbd1.slice/crio-d0470f55b3c307c5b8f8fea96ddf54bc0758ef481d02ecd14a44ed8f6f3955bb WatchSource:0}: Error finding container d0470f55b3c307c5b8f8fea96ddf54bc0758ef481d02ecd14a44ed8f6f3955bb: Status 404 returned error can't find the container with id d0470f55b3c307c5b8f8fea96ddf54bc0758ef481d02ecd14a44ed8f6f3955bb
Jul 29 03:26:39.316633 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:39.316593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" event={"ID":"744ea1a3-c77a-45c8-bd31-81784cbfbbd1","Type":"ContainerStarted","Data":"d0470f55b3c307c5b8f8fea96ddf54bc0758ef481d02ecd14a44ed8f6f3955bb"}
Jul 29 03:26:40.323772 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:40.323677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" event={"ID":"744ea1a3-c77a-45c8-bd31-81784cbfbbd1","Type":"ContainerStarted","Data":"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"}
Jul 29 03:26:40.343728 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:40.343680    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" podStartSLOduration=0.909405977 podStartE2EDuration="2.343659425s" totalImagesPullingTime="1.434253448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:40.341640106 +0000 UTC m=+3098.376356807" watchObservedRunningTime="2026-07-29 03:26:40.343659425 +0000 UTC m=+3098.378376114"
Jul 29 03:26:41.572829 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.572796    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:26:41.576623 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.576601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.579742 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.579712    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-6174a0\""
Jul 29 03:26:41.587512 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.587479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:26:41.612779 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.612745    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:26:41.616172 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.616152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.619697 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.619676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-6174a0-dockercfg-dkrp2\""
Jul 29 03:26:41.625567 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.625541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcls9\" (UniqueName: \"kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.625687 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.625578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.636786 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.636759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:26:41.726814 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.726773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcls9\" (UniqueName: \"kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.727032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.726824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.727032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.726862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.727032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.726887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldl2\" (UniqueName: \"kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.727703 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.727680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.736881 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.736845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcls9\" (UniqueName: \"kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9\") pod \"payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.828108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.828010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.828108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.828059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sldl2\" (UniqueName: \"kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.828757 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.828736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.839977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.839940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldl2\" (UniqueName: \"kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2\") pod \"payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:41.888198 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.888156    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:41.927683 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:41.927645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:42.067574 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.067540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:26:42.068871 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:26:42.068831    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb352a6_6fc5_44ab_b4f5_066f14f30971.slice/crio-62926fbc9bf5f329798513ffe8f8b18352ed8dffc1af4ff418525336fdfb0605 WatchSource:0}: Error finding container 62926fbc9bf5f329798513ffe8f8b18352ed8dffc1af4ff418525336fdfb0605: Status 404 returned error can't find the container with id 62926fbc9bf5f329798513ffe8f8b18352ed8dffc1af4ff418525336fdfb0605
Jul 29 03:26:42.120080 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:26:42.120051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ca772e_9ad4_483a_b52b_44fe5248933b.slice/crio-9676909be834dc67400240453c1721c93ffa2601b0bc7a3b762c3771b05a815d WatchSource:0}: Error finding container 9676909be834dc67400240453c1721c93ffa2601b0bc7a3b762c3771b05a815d: Status 404 returned error can't find the container with id 9676909be834dc67400240453c1721c93ffa2601b0bc7a3b762c3771b05a815d
Jul 29 03:26:42.120212 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.120188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:26:42.336850 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.336741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" event={"ID":"83ca772e-9ad4-483a-b52b-44fe5248933b","Type":"ContainerStarted","Data":"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"}
Jul 29 03:26:42.336850 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.336802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" event={"ID":"83ca772e-9ad4-483a-b52b-44fe5248933b","Type":"ContainerStarted","Data":"9676909be834dc67400240453c1721c93ffa2601b0bc7a3b762c3771b05a815d"}
Jul 29 03:26:42.337068 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.336855    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:42.338425 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.338395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" event={"ID":"8fb352a6-6fc5-44ab-b4f5-066f14f30971","Type":"ContainerStarted","Data":"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"}
Jul 29 03:26:42.338561 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.338446    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" event={"ID":"8fb352a6-6fc5-44ab-b4f5-066f14f30971","Type":"ContainerStarted","Data":"62926fbc9bf5f329798513ffe8f8b18352ed8dffc1af4ff418525336fdfb0605"}
Jul 29 03:26:42.338561 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.338479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:26:42.357990 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.357937    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" podStartSLOduration=1.357921433 podStartE2EDuration="1.357921433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:42.355342062 +0000 UTC m=+3100.390058787" watchObservedRunningTime="2026-07-29 03:26:42.357921433 +0000 UTC m=+3100.392638122"
Jul 29 03:26:42.374405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:42.374348    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" podStartSLOduration=1.374329709 podStartE2EDuration="1.374329709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:42.37219805 +0000 UTC m=+3100.406914741" watchObservedRunningTime="2026-07-29 03:26:42.374329709 +0000 UTC m=+3100.409046398"
Jul 29 03:26:48.361382 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:48.361337    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:48.361820 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:48.361430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:48.383839 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:48.383810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:48.409416 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:48.409390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:48.621760 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:48.621671    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:50.386451 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:50.386402    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" podUID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" containerName="registry-server" containerID="cri-o://48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea" gracePeriod=2
Jul 29 03:26:50.637983 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:50.637911    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:50.712063 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:50.712028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stv4v\" (UniqueName: \"kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v\") pod \"744ea1a3-c77a-45c8-bd31-81784cbfbbd1\" (UID: \"744ea1a3-c77a-45c8-bd31-81784cbfbbd1\") "
Jul 29 03:26:50.714209 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:50.714176    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v" (OuterVolumeSpecName: "kube-api-access-stv4v") pod "744ea1a3-c77a-45c8-bd31-81784cbfbbd1" (UID: "744ea1a3-c77a-45c8-bd31-81784cbfbbd1"). InnerVolumeSpecName "kube-api-access-stv4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:26:50.813701 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:50.813660    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stv4v\" (UniqueName: \"kubernetes.io/projected/744ea1a3-c77a-45c8-bd31-81784cbfbbd1-kube-api-access-stv4v\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:26:51.394108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.394068    2560 generic.go:356] "Generic (PLEG): container finished" podID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" containerID="48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea" exitCode=0
Jul 29 03:26:51.394632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.394119    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc"
Jul 29 03:26:51.394632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.394146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" event={"ID":"744ea1a3-c77a-45c8-bd31-81784cbfbbd1","Type":"ContainerDied","Data":"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"}
Jul 29 03:26:51.394632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.394197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lf8wc" event={"ID":"744ea1a3-c77a-45c8-bd31-81784cbfbbd1","Type":"ContainerDied","Data":"d0470f55b3c307c5b8f8fea96ddf54bc0758ef481d02ecd14a44ed8f6f3955bb"}
Jul 29 03:26:51.394632 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.394219    2560 scope.go:117] "RemoveContainer" containerID="48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"
Jul 29 03:26:51.404585 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.404567    2560 scope.go:117] "RemoveContainer" containerID="48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"
Jul 29 03:26:51.404849 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:26:51.404831    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea\": container with ID starting with 48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea not found: ID does not exist" containerID="48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"
Jul 29 03:26:51.404911 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.404855    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea"} err="failed to get container status \"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea\": rpc error: code = NotFound desc = could not find container \"48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea\": container with ID starting with 48e94b463bdb9d782919a1768030e5a8275c3182e7a344c950439f455a3522ea not found: ID does not exist"
Jul 29 03:26:51.418082 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.418041    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:51.421373 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:51.421347    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lf8wc"]
Jul 29 03:26:52.411371 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:52.411340    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" path="/var/lib/kubelet/pods/744ea1a3-c77a-45c8-bd31-81784cbfbbd1/volumes"
Jul 29 03:26:53.347120 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:53.347090    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:26:53.347570 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:26:53.347548    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:27:12.741290 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:27:12.741239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh_83ca772e-9ad4-483a-b52b-44fe5248933b/payload-processing/0.log"
Jul 29 03:28:18.080290 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:18.080236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz_2e077441-dde9-4d3a-834b-0ab7aeee01b2/payload-processing/0.log"
Jul 29 03:28:18.331693 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:18.331596    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh_83ca772e-9ad4-483a-b52b-44fe5248933b/payload-processing/0.log"
Jul 29 03:28:22.394333 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.394288    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:22.394889 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.394868    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" containerName="registry-server"
Jul 29 03:28:22.394991 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.394891    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" containerName="registry-server"
Jul 29 03:28:22.395048 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.395021    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="744ea1a3-c77a-45c8-bd31-81784cbfbbd1" containerName="registry-server"
Jul 29 03:28:22.398335 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.398314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.401167 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.401146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-002e42\""
Jul 29 03:28:22.401295 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.401208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-002e42-dockercfg-wt82b\""
Jul 29 03:28:22.411472 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.411447    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:22.413127 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.413099    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:22.417271 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.417231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.438156 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.438122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:22.453589 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.453558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc4lt\" (UniqueName: \"kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.453791 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.453768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.554356 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.554318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.554534 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.554389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.554534 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.554470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc4lt\" (UniqueName: \"kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.554534 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.554509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbp8\" (UniqueName: \"kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.555075 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.555054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.563691 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.563665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc4lt\" (UniqueName: \"kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt\") pod \"payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.655101 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.655002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.655304 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.655113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbp8\" (UniqueName: \"kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.655898 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.655878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.663212 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.663185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbp8\" (UniqueName: \"kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8\") pod \"payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.711113 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.711082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:22.732273 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.732219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:22.867774 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.867738    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:22.869141 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:28:22.869106    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a68af29_5861_49eb_9d7e_47683cfc272d.slice/crio-3d45f70e1a9a9ccbece611754677f72a25ba6f675ee0a2e7d329b4c5de0e2726 WatchSource:0}: Error finding container 3d45f70e1a9a9ccbece611754677f72a25ba6f675ee0a2e7d329b4c5de0e2726: Status 404 returned error can't find the container with id 3d45f70e1a9a9ccbece611754677f72a25ba6f675ee0a2e7d329b4c5de0e2726
Jul 29 03:28:22.929565 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:22.929535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" event={"ID":"8a68af29-5861-49eb-9d7e-47683cfc272d","Type":"ContainerStarted","Data":"3d45f70e1a9a9ccbece611754677f72a25ba6f675ee0a2e7d329b4c5de0e2726"}
Jul 29 03:28:23.104956 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.104930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:23.105814 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:28:23.105790    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae434bce_0f9f_434b_b9f3_7ea393f7d428.slice/crio-90c87c26cdd3c487e668e367f74c7775d1e066e69a7648db7707535ba929ba03 WatchSource:0}: Error finding container 90c87c26cdd3c487e668e367f74c7775d1e066e69a7648db7707535ba929ba03: Status 404 returned error can't find the container with id 90c87c26cdd3c487e668e367f74c7775d1e066e69a7648db7707535ba929ba03
Jul 29 03:28:23.937267 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.937218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" event={"ID":"8a68af29-5861-49eb-9d7e-47683cfc272d","Type":"ContainerStarted","Data":"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"}
Jul 29 03:28:23.937735 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.937439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:23.938954 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.938918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" event={"ID":"ae434bce-0f9f-434b-b9f3-7ea393f7d428","Type":"ContainerStarted","Data":"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"}
Jul 29 03:28:23.939069 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.938974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" event={"ID":"ae434bce-0f9f-434b-b9f3-7ea393f7d428","Type":"ContainerStarted","Data":"90c87c26cdd3c487e668e367f74c7775d1e066e69a7648db7707535ba929ba03"}
Jul 29 03:28:23.939069 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.938994    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:23.992273 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:23.992197    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" podStartSLOduration=1.9921799519999999 podStartE2EDuration="1.992179952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:28:23.989799413 +0000 UTC m=+3202.024516104" watchObservedRunningTime="2026-07-29 03:28:23.992179952 +0000 UTC m=+3202.026896970"
Jul 29 03:28:24.018360 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:24.018308    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" podStartSLOduration=2.018290782 podStartE2EDuration="2.018290782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:28:24.015778475 +0000 UTC m=+3202.050495166" watchObservedRunningTime="2026-07-29 03:28:24.018290782 +0000 UTC m=+3202.053007471"
Jul 29 03:28:34.946194 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:34.946162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:34.946613 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:34.946361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:47.236763 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.236720    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"]
Jul 29 03:28:47.240610 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.240589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:47.243145 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.243120    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:28:47.243379 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.243287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:28:47.247513 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.247488    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"]
Jul 29 03:28:47.372212 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.372166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279\" (UID: \"c9d43db7-d46c-442a-a09b-95d4e344402e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:47.472660 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.472624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279\" (UID: \"c9d43db7-d46c-442a-a09b-95d4e344402e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:47.473305 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.473281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279\" (UID: \"c9d43db7-d46c-442a-a09b-95d4e344402e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:47.553976 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.553881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:47.693513 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:47.693481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"]
Jul 29 03:28:47.695020 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:28:47.694992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d43db7_d46c_442a_a09b_95d4e344402e.slice/crio-389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170 WatchSource:0}: Error finding container 389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170: Status 404 returned error can't find the container with id 389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170
Jul 29 03:28:48.079621 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:48.079585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279" event={"ID":"c9d43db7-d46c-442a-a09b-95d4e344402e","Type":"ContainerStarted","Data":"bfe0e231a3d443743ea647aeb8ba3cdf0688ad4445a1126e4bf9f1851e31bc0b"}
Jul 29 03:28:48.079797 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:48.079636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279" event={"ID":"c9d43db7-d46c-442a-a09b-95d4e344402e","Type":"ContainerStarted","Data":"389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170"}
Jul 29 03:28:48.097846 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:48.097792    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279" podStartSLOduration=1.097775832 podStartE2EDuration="1.097775832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:28:48.096599778 +0000 UTC m=+3226.131316469" watchObservedRunningTime="2026-07-29 03:28:48.097775832 +0000 UTC m=+3226.132492522"
Jul 29 03:28:49.087139 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:49.087107    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9d43db7-d46c-442a-a09b-95d4e344402e" containerID="bfe0e231a3d443743ea647aeb8ba3cdf0688ad4445a1126e4bf9f1851e31bc0b" exitCode=0
Jul 29 03:28:49.087551 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:49.087159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279" event={"ID":"c9d43db7-d46c-442a-a09b-95d4e344402e","Type":"ContainerDied","Data":"bfe0e231a3d443743ea647aeb8ba3cdf0688ad4445a1126e4bf9f1851e31bc0b"}
Jul 29 03:28:50.240712 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:50.240684    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:50.297596 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:50.297562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca\") pod \"c9d43db7-d46c-442a-a09b-95d4e344402e\" (UID: \"c9d43db7-d46c-442a-a09b-95d4e344402e\") "
Jul 29 03:28:50.297919 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:50.297896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9d43db7-d46c-442a-a09b-95d4e344402e" (UID: "c9d43db7-d46c-442a-a09b-95d4e344402e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:28:50.398743 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:50.398653    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d43db7-d46c-442a-a09b-95d4e344402e-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:28:51.099617 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:51.099586    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"
Jul 29 03:28:51.099795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:51.099623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279" event={"ID":"c9d43db7-d46c-442a-a09b-95d4e344402e","Type":"ContainerDied","Data":"389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170"}
Jul 29 03:28:51.099795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:51.099668    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="389676ca22e4a4a025283be9766818cb0704e97ed1240fd792c8a6cd62f23170"
Jul 29 03:28:52.335812 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.335772    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:52.336229 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.336022    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" podUID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" containerName="payload-processing" containerID="cri-o://1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a" gracePeriod=30
Jul 29 03:28:52.344855 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.344826    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:52.345139 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.345080    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" podUID="8a68af29-5861-49eb-9d7e-47683cfc272d" containerName="payload-pre-processing" containerID="cri-o://f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b" gracePeriod=30
Jul 29 03:28:52.494396 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.494350    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"]
Jul 29 03:28:52.497059 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.497027    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-002e42-p7279"]
Jul 29 03:28:52.618214 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.618189    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:52.645431 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.645401    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:52.720932 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.720893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc4lt\" (UniqueName: \"kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt\") pod \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") "
Jul 29 03:28:52.721121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.720951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume\") pod \"8a68af29-5861-49eb-9d7e-47683cfc272d\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") "
Jul 29 03:28:52.721121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.720987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume\") pod \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\" (UID: \"ae434bce-0f9f-434b-b9f3-7ea393f7d428\") "
Jul 29 03:28:52.721121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.721008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbp8\" (UniqueName: \"kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8\") pod \"8a68af29-5861-49eb-9d7e-47683cfc272d\" (UID: \"8a68af29-5861-49eb-9d7e-47683cfc272d\") "
Jul 29 03:28:52.721510 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.721479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae434bce-0f9f-434b-b9f3-7ea393f7d428" (UID: "ae434bce-0f9f-434b-b9f3-7ea393f7d428"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:28:52.721631 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.721552    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a68af29-5861-49eb-9d7e-47683cfc272d" (UID: "8a68af29-5861-49eb-9d7e-47683cfc272d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:28:52.723170 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.723137    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt" (OuterVolumeSpecName: "kube-api-access-vc4lt") pod "ae434bce-0f9f-434b-b9f3-7ea393f7d428" (UID: "ae434bce-0f9f-434b-b9f3-7ea393f7d428"). InnerVolumeSpecName "kube-api-access-vc4lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:28:52.723170 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.723155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8" (OuterVolumeSpecName: "kube-api-access-tmbp8") pod "8a68af29-5861-49eb-9d7e-47683cfc272d" (UID: "8a68af29-5861-49eb-9d7e-47683cfc272d"). InnerVolumeSpecName "kube-api-access-tmbp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:28:52.822382 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.822344    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a68af29-5861-49eb-9d7e-47683cfc272d-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:28:52.822382 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.822375    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae434bce-0f9f-434b-b9f3-7ea393f7d428-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:28:52.822382 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.822385    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbp8\" (UniqueName: \"kubernetes.io/projected/8a68af29-5861-49eb-9d7e-47683cfc272d-kube-api-access-tmbp8\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:28:52.822640 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:52.822398    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc4lt\" (UniqueName: \"kubernetes.io/projected/ae434bce-0f9f-434b-b9f3-7ea393f7d428-kube-api-access-vc4lt\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:28:53.115819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.113473    2560 generic.go:356] "Generic (PLEG): container finished" podID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" containerID="1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a" exitCode=0
Jul 29 03:28:53.115819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.113643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" event={"ID":"ae434bce-0f9f-434b-b9f3-7ea393f7d428","Type":"ContainerDied","Data":"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"}
Jul 29 03:28:53.115819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.113697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2" event={"ID":"ae434bce-0f9f-434b-b9f3-7ea393f7d428","Type":"ContainerDied","Data":"90c87c26cdd3c487e668e367f74c7775d1e066e69a7648db7707535ba929ba03"}
Jul 29 03:28:53.115819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.113728    2560 scope.go:117] "RemoveContainer" containerID="1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"
Jul 29 03:28:53.115819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.113887    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"
Jul 29 03:28:53.117700 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.117656    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a68af29-5861-49eb-9d7e-47683cfc272d" containerID="f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b" exitCode=0
Jul 29 03:28:53.117843 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.117701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"
Jul 29 03:28:53.117843 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.117742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" event={"ID":"8a68af29-5861-49eb-9d7e-47683cfc272d","Type":"ContainerDied","Data":"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"}
Jul 29 03:28:53.117843 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.117804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8" event={"ID":"8a68af29-5861-49eb-9d7e-47683cfc272d","Type":"ContainerDied","Data":"3d45f70e1a9a9ccbece611754677f72a25ba6f675ee0a2e7d329b4c5de0e2726"}
Jul 29 03:28:53.127586 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.127552    2560 scope.go:117] "RemoveContainer" containerID="1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"
Jul 29 03:28:53.127951 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:28:53.127922    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a\": container with ID starting with 1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a not found: ID does not exist" containerID="1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"
Jul 29 03:28:53.128049 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.127958    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a"} err="failed to get container status \"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a\": rpc error: code = NotFound desc = could not find container \"1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a\": container with ID starting with 1abdfb909003d8c8f85e136b703f18fed0103dff3877771dd6a388dff57f912a not found: ID does not exist"
Jul 29 03:28:53.128049 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.127976    2560 scope.go:117] "RemoveContainer" containerID="f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"
Jul 29 03:28:53.136824 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.136804    2560 scope.go:117] "RemoveContainer" containerID="f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"
Jul 29 03:28:53.137126 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:28:53.137106    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b\": container with ID starting with f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b not found: ID does not exist" containerID="f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"
Jul 29 03:28:53.137196 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.137138    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b"} err="failed to get container status \"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b\": rpc error: code = NotFound desc = could not find container \"f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b\": container with ID starting with f73ea1a79cf1315b8165afca1ffc13de9da5cfe20183a35f3e4e26346aab018b not found: ID does not exist"
Jul 29 03:28:53.144618 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.144587    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:53.149305 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.149276    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-002e42-564fdbd6cd-9nqs2"]
Jul 29 03:28:53.161543 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.161512    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:53.165224 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:53.165197    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-002e42-67b779589b-bqzk8"]
Jul 29 03:28:54.408695 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:54.408608    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a68af29-5861-49eb-9d7e-47683cfc272d" path="/var/lib/kubelet/pods/8a68af29-5861-49eb-9d7e-47683cfc272d/volumes"
Jul 29 03:28:54.409061 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:54.408966    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" path="/var/lib/kubelet/pods/ae434bce-0f9f-434b-b9f3-7ea393f7d428/volumes"
Jul 29 03:28:54.409254 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:28:54.409229    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d43db7-d46c-442a-a09b-95d4e344402e" path="/var/lib/kubelet/pods/c9d43db7-d46c-442a-a09b-95d4e344402e/volumes"
Jul 29 03:29:02.558642 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.558599    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"]
Jul 29 03:29:02.559795 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559761    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" containerName="payload-processing"
Jul 29 03:29:02.559938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" containerName="payload-processing"
Jul 29 03:29:02.559938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559834    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d43db7-d46c-442a-a09b-95d4e344402e" containerName="revoke-keys"
Jul 29 03:29:02.559938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559844    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d43db7-d46c-442a-a09b-95d4e344402e" containerName="revoke-keys"
Jul 29 03:29:02.559938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559870    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a68af29-5861-49eb-9d7e-47683cfc272d" containerName="payload-pre-processing"
Jul 29 03:29:02.559938 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.559880    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a68af29-5861-49eb-9d7e-47683cfc272d" containerName="payload-pre-processing"
Jul 29 03:29:02.560154 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.560079    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d43db7-d46c-442a-a09b-95d4e344402e" containerName="revoke-keys"
Jul 29 03:29:02.560154 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.560101    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a68af29-5861-49eb-9d7e-47683cfc272d" containerName="payload-pre-processing"
Jul 29 03:29:02.560154 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.560113    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae434bce-0f9f-434b-b9f3-7ea393f7d428" containerName="payload-processing"
Jul 29 03:29:02.566002 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.565975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:02.566641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.566610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"]
Jul 29 03:29:02.568653 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.568632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:29:02.568758 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.568629    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:29:02.718295 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.718221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz\" (UID: \"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:02.819170 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.819069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz\" (UID: \"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:02.819724 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.819704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz\" (UID: \"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:02.878572 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:02.878536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:03.020649 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:03.020617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"]
Jul 29 03:29:03.022985 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:29:03.022947    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc09af2_4f8f_47ac_b41b_fecf9e715c1b.slice/crio-94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b WatchSource:0}: Error finding container 94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b: Status 404 returned error can't find the container with id 94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b
Jul 29 03:29:03.184018 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:03.183987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz" event={"ID":"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b","Type":"ContainerStarted","Data":"94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b"}
Jul 29 03:29:04.191809 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:04.191777    2560 generic.go:356] "Generic (PLEG): container finished" podID="7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" containerID="14a58470df2be89dce649f33d300c417990654aacbb350c89ce02824c0bbd0e5" exitCode=0
Jul 29 03:29:04.192299 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:04.191857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz" event={"ID":"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b","Type":"ContainerDied","Data":"14a58470df2be89dce649f33d300c417990654aacbb350c89ce02824c0bbd0e5"}
Jul 29 03:29:05.340200 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:05.340173    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:05.443046 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:05.443010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca\") pod \"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b\" (UID: \"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b\") "
Jul 29 03:29:05.443425 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:05.443401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" (UID: "7cc09af2-4f8f-47ac-b41b-fecf9e715c1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:29:05.543872 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:05.543778    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:29:06.204726 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:06.204697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz" event={"ID":"7cc09af2-4f8f-47ac-b41b-fecf9e715c1b","Type":"ContainerDied","Data":"94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b"}
Jul 29 03:29:06.204899 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:06.204742    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94c7259c6edf612a3389c390acd50f9d4e97d73f771b84b880bf576311b3e29b"
Jul 29 03:29:06.204899 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:06.204705    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"
Jul 29 03:29:06.242762 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:29:06.242726    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc09af2_4f8f_47ac_b41b_fecf9e715c1b.slice\": RecentStats: unable to find data in memory cache]"
Jul 29 03:29:18.290224 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.290186    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:29:18.290737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.290451    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" podUID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" containerName="payload-processing" containerID="cri-o://32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75" gracePeriod=30
Jul 29 03:29:18.304138 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.303605    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:29:18.304138 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.303818    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" podUID="b2d00100-580f-4040-9bd2-a0c5e97b044c" containerName="payload-pre-processing" containerID="cri-o://1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1" gracePeriod=30
Jul 29 03:29:18.447757 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.447567    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"]
Jul 29 03:29:18.450592 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.450552    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf2f02-5c9hz"]
Jul 29 03:29:18.601178 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.601154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:29:18.604209 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.604186    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:29:18.656988 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.656954    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqpq5\" (UniqueName: \"kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5\") pod \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") "
Jul 29 03:29:18.657175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.657002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume\") pod \"b2d00100-580f-4040-9bd2-a0c5e97b044c\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") "
Jul 29 03:29:18.657175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.657039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume\") pod \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\" (UID: \"2e077441-dde9-4d3a-834b-0ab7aeee01b2\") "
Jul 29 03:29:18.657175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.657080    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprj2\" (UniqueName: \"kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2\") pod \"b2d00100-580f-4040-9bd2-a0c5e97b044c\" (UID: \"b2d00100-580f-4040-9bd2-a0c5e97b044c\") "
Jul 29 03:29:18.657517 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.657488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2d00100-580f-4040-9bd2-a0c5e97b044c" (UID: "b2d00100-580f-4040-9bd2-a0c5e97b044c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:29:18.657625 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.657545    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e077441-dde9-4d3a-834b-0ab7aeee01b2" (UID: "2e077441-dde9-4d3a-834b-0ab7aeee01b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:29:18.659275 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.659238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5" (OuterVolumeSpecName: "kube-api-access-mqpq5") pod "2e077441-dde9-4d3a-834b-0ab7aeee01b2" (UID: "2e077441-dde9-4d3a-834b-0ab7aeee01b2"). InnerVolumeSpecName "kube-api-access-mqpq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:29:18.659364 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.659295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2" (OuterVolumeSpecName: "kube-api-access-hprj2") pod "b2d00100-580f-4040-9bd2-a0c5e97b044c" (UID: "b2d00100-580f-4040-9bd2-a0c5e97b044c"). InnerVolumeSpecName "kube-api-access-hprj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:29:18.758671 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.758632    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqpq5\" (UniqueName: \"kubernetes.io/projected/2e077441-dde9-4d3a-834b-0ab7aeee01b2-kube-api-access-mqpq5\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.758671 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.758664    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d00100-580f-4040-9bd2-a0c5e97b044c-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.758671 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.758673    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e077441-dde9-4d3a-834b-0ab7aeee01b2-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.758671 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:18.758682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprj2\" (UniqueName: \"kubernetes.io/projected/b2d00100-580f-4040-9bd2-a0c5e97b044c-kube-api-access-hprj2\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:29:19.280890 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.280850    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" containerID="32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75" exitCode=0
Jul 29 03:29:19.280890 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.280895    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"
Jul 29 03:29:19.281128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.280933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" event={"ID":"2e077441-dde9-4d3a-834b-0ab7aeee01b2","Type":"ContainerDied","Data":"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"}
Jul 29 03:29:19.281128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.281002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz" event={"ID":"2e077441-dde9-4d3a-834b-0ab7aeee01b2","Type":"ContainerDied","Data":"6214e2f4d3e9a5232990543a6d0ca1074158e6dfbf4f621c2023da0787145fc6"}
Jul 29 03:29:19.281128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.281031    2560 scope.go:117] "RemoveContainer" containerID="32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"
Jul 29 03:29:19.282356 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.282330    2560 generic.go:356] "Generic (PLEG): container finished" podID="b2d00100-580f-4040-9bd2-a0c5e97b044c" containerID="1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1" exitCode=0
Jul 29 03:29:19.282492 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.282366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"
Jul 29 03:29:19.282492 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.282419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" event={"ID":"b2d00100-580f-4040-9bd2-a0c5e97b044c","Type":"ContainerDied","Data":"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"}
Jul 29 03:29:19.282492 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.282472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427" event={"ID":"b2d00100-580f-4040-9bd2-a0c5e97b044c","Type":"ContainerDied","Data":"da33a9d8732207f6a3d4982ee383a3af9a27c7c93041985f3bed15891b38e240"}
Jul 29 03:29:19.300083 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.299971    2560 scope.go:117] "RemoveContainer" containerID="32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"
Jul 29 03:29:19.300372 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:29:19.300352    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75\": container with ID starting with 32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75 not found: ID does not exist" containerID="32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"
Jul 29 03:29:19.300414 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.300377    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75"} err="failed to get container status \"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75\": rpc error: code = NotFound desc = could not find container \"32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75\": container with ID starting with 32ea432bab31e0708408690efef834632b73063e2497045f7abda1cb11f4ce75 not found: ID does not exist"
Jul 29 03:29:19.300414 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.300396    2560 scope.go:117] "RemoveContainer" containerID="1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"
Jul 29 03:29:19.315050 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.315018    2560 scope.go:117] "RemoveContainer" containerID="1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"
Jul 29 03:29:19.315499 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:29:19.315467    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1\": container with ID starting with 1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1 not found: ID does not exist" containerID="1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"
Jul 29 03:29:19.315584 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.315512    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1"} err="failed to get container status \"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1\": rpc error: code = NotFound desc = could not find container \"1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1\": container with ID starting with 1151777f5751524808086cea18ea714fe23283a26938213ed5716725f24783c1 not found: ID does not exist"
Jul 29 03:29:19.317417 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.317394    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:29:19.323491 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.323452    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bf2f02-84cc7b5c7d-xbnfz"]
Jul 29 03:29:19.334584 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.334551    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:29:19.343092 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:19.343055    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bf2f02-5565ddc4dd-q2427"]
Jul 29 03:29:20.408714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:20.408678    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" path="/var/lib/kubelet/pods/2e077441-dde9-4d3a-834b-0ab7aeee01b2/volumes"
Jul 29 03:29:20.409103 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:20.409014    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" path="/var/lib/kubelet/pods/7cc09af2-4f8f-47ac-b41b-fecf9e715c1b/volumes"
Jul 29 03:29:20.409358 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:29:20.409345    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d00100-580f-4040-9bd2-a0c5e97b044c" path="/var/lib/kubelet/pods/b2d00100-580f-4040-9bd2-a0c5e97b044c/volumes"
Jul 29 03:30:00.139861 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.139823    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"]
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140239    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" containerName="revoke-keys"
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140281    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" containerName="revoke-keys"
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140315    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d00100-580f-4040-9bd2-a0c5e97b044c" containerName="payload-pre-processing"
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140321    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d00100-580f-4040-9bd2-a0c5e97b044c" containerName="payload-pre-processing"
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140327    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" containerName="payload-processing"
Jul 29 03:30:00.140362 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140333    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" containerName="payload-processing"
Jul 29 03:30:00.140560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140398    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d00100-580f-4040-9bd2-a0c5e97b044c" containerName="payload-pre-processing"
Jul 29 03:30:00.140560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140405    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e077441-dde9-4d3a-834b-0ab7aeee01b2" containerName="payload-processing"
Jul 29 03:30:00.140560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.140415    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc09af2-4f8f-47ac-b41b-fecf9e715c1b" containerName="revoke-keys"
Jul 29 03:30:00.143499 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.143482    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"]
Jul 29 03:30:00.143642 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.143624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"
Jul 29 03:30:00.146218 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.146192    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:30:00.146880 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.146862    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"]
Jul 29 03:30:00.147002 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.146971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"
Jul 29 03:30:00.154266 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.154216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"]
Jul 29 03:30:00.161725 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.161696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"
Jul 29 03:30:00.163969 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.162550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"
Jul 29 03:30:00.163969 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.163275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"]
Jul 29 03:30:00.163969 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.163323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"]
Jul 29 03:30:00.163969 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.163419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"
Jul 29 03:30:00.177051 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.176997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"]
Jul 29 03:30:00.178342 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.178316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"
Jul 29 03:30:00.180363 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.180328    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"]
Jul 29 03:30:00.218261 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.218214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"
Jul 29 03:30:00.227280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.227257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"
Jul 29 03:30:00.387685 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.387636    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"]
Jul 29 03:30:00.389935 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:00.389842    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6e10b8_f34a_4b3b_b7eb_7097b430abd6.slice/crio-6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2 WatchSource:0}: Error finding container 6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2: Status 404 returned error can't find the container with id 6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2
Jul 29 03:30:00.527722 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.527687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4" event={"ID":"ee6e10b8-f34a-4b3b-b7eb-7097b430abd6","Type":"ContainerStarted","Data":"6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2"}
Jul 29 03:30:00.617763 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.617734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"]
Jul 29 03:30:00.618864 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:00.618823    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc239a412_704f_4692_9efb_9e83fcb02a58.slice/crio-b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e WatchSource:0}: Error finding container b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e: Status 404 returned error can't find the container with id b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e
Jul 29 03:30:00.654375 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.654342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"]
Jul 29 03:30:00.655633 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:00.655601    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927a836a_12af_465d_8af8_957122571c37.slice/crio-8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b WatchSource:0}: Error finding container 8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b: Status 404 returned error can't find the container with id 8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b
Jul 29 03:30:00.663809 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:00.663786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"]
Jul 29 03:30:00.665236 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:00.665213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785312a5_2a05_4ac3_9505_5097b23f0d4f.slice/crio-54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577 WatchSource:0}: Error finding container 54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577: Status 404 returned error can't find the container with id 54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577
Jul 29 03:30:01.534788 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.534689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8" event={"ID":"785312a5-2a05-4ac3-9505-5097b23f0d4f","Type":"ContainerStarted","Data":"5b98ee6fa2f3207d3687aba7f145929d9798f233a0b174159e83b7eb5f602c67"}
Jul 29 03:30:01.534788 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.534750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8" event={"ID":"785312a5-2a05-4ac3-9505-5097b23f0d4f","Type":"ContainerStarted","Data":"54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577"}
Jul 29 03:30:01.536182 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.536154    2560 generic.go:356] "Generic (PLEG): container finished" podID="ee6e10b8-f34a-4b3b-b7eb-7097b430abd6" containerID="8bb2cc5e68c2ff77d90c9f8d7591dc9ff1e88f0b97eb5cb2f0d9ca8608937978" exitCode=0
Jul 29 03:30:01.536313 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.536219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4" event={"ID":"ee6e10b8-f34a-4b3b-b7eb-7097b430abd6","Type":"ContainerDied","Data":"8bb2cc5e68c2ff77d90c9f8d7591dc9ff1e88f0b97eb5cb2f0d9ca8608937978"}
Jul 29 03:30:01.537667 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.537637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq" event={"ID":"927a836a-12af-465d-8af8-957122571c37","Type":"ContainerStarted","Data":"895bdefd74748c00df78c34714f8da7c0c1f9b89fad5a081a4ba47d1e720f031"}
Jul 29 03:30:01.537796 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.537682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq" event={"ID":"927a836a-12af-465d-8af8-957122571c37","Type":"ContainerStarted","Data":"8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b"}
Jul 29 03:30:01.539195 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.539171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq" event={"ID":"c239a412-704f-4692-9efb-9e83fcb02a58","Type":"ContainerStarted","Data":"4381d959dadaf8f2d7a4ac4119bd6ff1a89bbd0ba457d24a3405840d62b19002"}
Jul 29 03:30:01.539524 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.539213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq" event={"ID":"c239a412-704f-4692-9efb-9e83fcb02a58","Type":"ContainerStarted","Data":"b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e"}
Jul 29 03:30:01.551969 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.551913    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8" podStartSLOduration=1.551896682 podStartE2EDuration="1.551896682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:30:01.550860943 +0000 UTC m=+3299.585577632" watchObservedRunningTime="2026-07-29 03:30:01.551896682 +0000 UTC m=+3299.586613365"
Jul 29 03:30:01.568838 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.568780    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq" podStartSLOduration=1.5687633330000001 podStartE2EDuration="1.568763333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:30:01.566631497 +0000 UTC m=+3299.601348187" watchObservedRunningTime="2026-07-29 03:30:01.568763333 +0000 UTC m=+3299.603480019"
Jul 29 03:30:01.582732 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:01.582676    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq" podStartSLOduration=1.582651813 podStartE2EDuration="1.582651813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:30:01.582145265 +0000 UTC m=+3299.616861955" watchObservedRunningTime="2026-07-29 03:30:01.582651813 +0000 UTC m=+3299.617368501"
Jul 29 03:30:02.554974 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.554921    2560 generic.go:356] "Generic (PLEG): container finished" podID="927a836a-12af-465d-8af8-957122571c37" containerID="895bdefd74748c00df78c34714f8da7c0c1f9b89fad5a081a4ba47d1e720f031" exitCode=0
Jul 29 03:30:02.555414 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.555001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq" event={"ID":"927a836a-12af-465d-8af8-957122571c37","Type":"ContainerDied","Data":"895bdefd74748c00df78c34714f8da7c0c1f9b89fad5a081a4ba47d1e720f031"}
Jul 29 03:30:02.556762 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.556738    2560 generic.go:356] "Generic (PLEG): container finished" podID="c239a412-704f-4692-9efb-9e83fcb02a58" containerID="4381d959dadaf8f2d7a4ac4119bd6ff1a89bbd0ba457d24a3405840d62b19002" exitCode=0
Jul 29 03:30:02.556874 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.556827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq" event={"ID":"c239a412-704f-4692-9efb-9e83fcb02a58","Type":"ContainerDied","Data":"4381d959dadaf8f2d7a4ac4119bd6ff1a89bbd0ba457d24a3405840d62b19002"}
Jul 29 03:30:02.558613 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.558589    2560 generic.go:356] "Generic (PLEG): container finished" podID="785312a5-2a05-4ac3-9505-5097b23f0d4f" containerID="5b98ee6fa2f3207d3687aba7f145929d9798f233a0b174159e83b7eb5f602c67" exitCode=0
Jul 29 03:30:02.558701 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.558648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8" event={"ID":"785312a5-2a05-4ac3-9505-5097b23f0d4f","Type":"ContainerDied","Data":"5b98ee6fa2f3207d3687aba7f145929d9798f233a0b174159e83b7eb5f602c67"}
Jul 29 03:30:02.698686 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.698660    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"
Jul 29 03:30:02.845645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.845492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:30:02.865347 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:02.863984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:30:03.565890 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.565861    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"
Jul 29 03:30:03.566324 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.565909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4" event={"ID":"ee6e10b8-f34a-4b3b-b7eb-7097b430abd6","Type":"ContainerDied","Data":"6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2"}
Jul 29 03:30:03.566324 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.565962    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bc425b61037d38341e54e85f058d009bf78014ef2fcdef8ad0ae51d7527caa2"
Jul 29 03:30:03.710061 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.710025    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"
Jul 29 03:30:03.757789 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.757764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"
Jul 29 03:30:03.760762 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:03.760736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"
Jul 29 03:30:04.573097 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.573073    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"
Jul 29 03:30:04.573530 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.573114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8" event={"ID":"785312a5-2a05-4ac3-9505-5097b23f0d4f","Type":"ContainerDied","Data":"54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577"}
Jul 29 03:30:04.573530 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.573170    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54dd7848c35be8def6c690ded52c97bc338ec58b889587677048b6fda4579577"
Jul 29 03:30:04.574483 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.574462    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq"
Jul 29 03:30:04.574483 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.574470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754930-52wgq" event={"ID":"927a836a-12af-465d-8af8-957122571c37","Type":"ContainerDied","Data":"8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b"}
Jul 29 03:30:04.574646 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.574513    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b07951c4017f2a4f0b8852d06a717d0d87a83f2aef26f1e089f0cade5b1f94b"
Jul 29 03:30:04.576021 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.575996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq" event={"ID":"c239a412-704f-4692-9efb-9e83fcb02a58","Type":"ContainerDied","Data":"b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e"}
Jul 29 03:30:04.576021 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.576022    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"
Jul 29 03:30:04.576223 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.576041    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1ef0496562adaa58cfda06998690df1c11dd7b32bec21c5be25f8ec1ddb543e"
Jul 29 03:30:04.619079 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.619044    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"]
Jul 29 03:30:04.624539 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:04.624507    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754885-gqkqf"]
Jul 29 03:30:06.408302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:06.408266    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea137ffc-471c-4c69-a3ae-9ee66a89f206" path="/var/lib/kubelet/pods/ea137ffc-471c-4c69-a3ae-9ee66a89f206/volumes"
Jul 29 03:30:12.444966 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.444926    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"]
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445327    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c239a412-704f-4692-9efb-9e83fcb02a58" containerName="cleanup"
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445342    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c239a412-704f-4692-9efb-9e83fcb02a58" containerName="cleanup"
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445356    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785312a5-2a05-4ac3-9505-5097b23f0d4f" containerName="cleanup"
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445362    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="785312a5-2a05-4ac3-9505-5097b23f0d4f" containerName="cleanup"
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445369    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee6e10b8-f34a-4b3b-b7eb-7097b430abd6" containerName="cleanup"
Jul 29 03:30:12.445374 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445376    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee6e10b8-f34a-4b3b-b7eb-7097b430abd6" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445382    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927a836a-12af-465d-8af8-957122571c37" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445387    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="927a836a-12af-465d-8af8-957122571c37" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445461    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c239a412-704f-4692-9efb-9e83fcb02a58" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445474    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee6e10b8-f34a-4b3b-b7eb-7097b430abd6" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445481    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="927a836a-12af-465d-8af8-957122571c37" containerName="cleanup"
Jul 29 03:30:12.445614 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.445487    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="785312a5-2a05-4ac3-9505-5097b23f0d4f" containerName="cleanup"
Jul 29 03:30:12.448775 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.448756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:12.451509 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.451482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:30:12.451662 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.451560    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:30:12.456223 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.456192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"]
Jul 29 03:30:12.540207 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.540161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p\" (UID: \"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:12.641075 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.641037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p\" (UID: \"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:12.641697 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.641675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p\" (UID: \"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:12.760307 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.760190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:12.899092 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:12.899063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"]
Jul 29 03:30:12.900352 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:12.900314    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9076b71_6354_4e4e_b2b2_0a97ffbf3d42.slice/crio-aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee WatchSource:0}: Error finding container aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee: Status 404 returned error can't find the container with id aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee
Jul 29 03:30:13.627256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:13.627206    2560 generic.go:356] "Generic (PLEG): container finished" podID="a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" containerID="6d5b643f851b3bbe77d35efd5a928625b51b16277cbce094d663de5d9beb7508" exitCode=0
Jul 29 03:30:13.627695 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:13.627289    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p" event={"ID":"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42","Type":"ContainerDied","Data":"6d5b643f851b3bbe77d35efd5a928625b51b16277cbce094d663de5d9beb7508"}
Jul 29 03:30:13.627695 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:13.627342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p" event={"ID":"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42","Type":"ContainerStarted","Data":"aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee"}
Jul 29 03:30:14.771445 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:14.771420    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:14.856834 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:14.856791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca\") pod \"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42\" (UID: \"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42\") "
Jul 29 03:30:14.857139 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:14.857116    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" (UID: "a9076b71-6354-4e4e-b2b2-0a97ffbf3d42"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:14.957408 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:14.957367    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:15.641114 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:15.641090    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"
Jul 29 03:30:15.641377 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:15.641089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p" event={"ID":"a9076b71-6354-4e4e-b2b2-0a97ffbf3d42","Type":"ContainerDied","Data":"aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee"}
Jul 29 03:30:15.641457 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:15.641413    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa5a6bf2d19ede83fde93639dad810a5fbbe8804ffe0ca8a946a854f89bc84ee"
Jul 29 03:30:22.899376 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.899342    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"]
Jul 29 03:30:22.903567 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.903543    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-6174a0-29754930-nr7b8"]
Jul 29 03:30:22.932117 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.932079    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:30:22.932418 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.932390    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" podUID="83ca772e-9ad4-483a-b52b-44fe5248933b" containerName="payload-processing" containerID="cri-o://db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667" gracePeriod=30
Jul 29 03:30:22.939427 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.939387    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:30:22.939678 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:22.939626    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" podUID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" containerName="payload-pre-processing" containerID="cri-o://80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585" gracePeriod=30
Jul 29 03:30:23.086653 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.086595    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"]
Jul 29 03:30:23.089980 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.089941    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6174a0-7vw9p"]
Jul 29 03:30:23.218559 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.218533    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:30:23.221274 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.221235    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:30:23.323641 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.323596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume\") pod \"83ca772e-9ad4-483a-b52b-44fe5248933b\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") "
Jul 29 03:30:23.323827 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.323685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcls9\" (UniqueName: \"kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9\") pod \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") "
Jul 29 03:30:23.323827 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.323706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sldl2\" (UniqueName: \"kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2\") pod \"83ca772e-9ad4-483a-b52b-44fe5248933b\" (UID: \"83ca772e-9ad4-483a-b52b-44fe5248933b\") "
Jul 29 03:30:23.323827 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.323725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume\") pod \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\" (UID: \"8fb352a6-6fc5-44ab-b4f5-066f14f30971\") "
Jul 29 03:30:23.324096 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.324066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83ca772e-9ad4-483a-b52b-44fe5248933b" (UID: "83ca772e-9ad4-483a-b52b-44fe5248933b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:23.324181 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.324164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fb352a6-6fc5-44ab-b4f5-066f14f30971" (UID: "8fb352a6-6fc5-44ab-b4f5-066f14f30971"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:23.325909 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.325886    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9" (OuterVolumeSpecName: "kube-api-access-fcls9") pod "8fb352a6-6fc5-44ab-b4f5-066f14f30971" (UID: "8fb352a6-6fc5-44ab-b4f5-066f14f30971"). InnerVolumeSpecName "kube-api-access-fcls9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:23.325965 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.325920    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2" (OuterVolumeSpecName: "kube-api-access-sldl2") pod "83ca772e-9ad4-483a-b52b-44fe5248933b" (UID: "83ca772e-9ad4-483a-b52b-44fe5248933b"). InnerVolumeSpecName "kube-api-access-sldl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:23.424852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.424810    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcls9\" (UniqueName: \"kubernetes.io/projected/8fb352a6-6fc5-44ab-b4f5-066f14f30971-kube-api-access-fcls9\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.424852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.424846    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sldl2\" (UniqueName: \"kubernetes.io/projected/83ca772e-9ad4-483a-b52b-44fe5248933b-kube-api-access-sldl2\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.424852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.424855    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb352a6-6fc5-44ab-b4f5-066f14f30971-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.424852 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.424864    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83ca772e-9ad4-483a-b52b-44fe5248933b-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.691822 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.691781    2560 generic.go:356] "Generic (PLEG): container finished" podID="83ca772e-9ad4-483a-b52b-44fe5248933b" containerID="db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667" exitCode=0
Jul 29 03:30:23.692026 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.691830    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"
Jul 29 03:30:23.692026 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.691868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" event={"ID":"83ca772e-9ad4-483a-b52b-44fe5248933b","Type":"ContainerDied","Data":"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"}
Jul 29 03:30:23.692026 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.691929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh" event={"ID":"83ca772e-9ad4-483a-b52b-44fe5248933b","Type":"ContainerDied","Data":"9676909be834dc67400240453c1721c93ffa2601b0bc7a3b762c3771b05a815d"}
Jul 29 03:30:23.692026 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.691957    2560 scope.go:117] "RemoveContainer" containerID="db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"
Jul 29 03:30:23.693426 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.693396    2560 generic.go:356] "Generic (PLEG): container finished" podID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" containerID="80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585" exitCode=0
Jul 29 03:30:23.693551 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.693439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" event={"ID":"8fb352a6-6fc5-44ab-b4f5-066f14f30971","Type":"ContainerDied","Data":"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"}
Jul 29 03:30:23.693551 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.693446    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"
Jul 29 03:30:23.693551 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.693472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq" event={"ID":"8fb352a6-6fc5-44ab-b4f5-066f14f30971","Type":"ContainerDied","Data":"62926fbc9bf5f329798513ffe8f8b18352ed8dffc1af4ff418525336fdfb0605"}
Jul 29 03:30:23.704607 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.704153    2560 scope.go:117] "RemoveContainer" containerID="db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"
Jul 29 03:30:23.704607 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:30:23.704560    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667\": container with ID starting with db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667 not found: ID does not exist" containerID="db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"
Jul 29 03:30:23.704607 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.704591    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667"} err="failed to get container status \"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667\": rpc error: code = NotFound desc = could not find container \"db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667\": container with ID starting with db8930b76be4f1b8c2ba1fb8640f32eb7262c6e32d9c748a149ca5991a27d667 not found: ID does not exist"
Jul 29 03:30:23.704901 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.704611    2560 scope.go:117] "RemoveContainer" containerID="80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"
Jul 29 03:30:23.712890 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.712872    2560 scope.go:117] "RemoveContainer" containerID="80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"
Jul 29 03:30:23.713135 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:30:23.713115    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585\": container with ID starting with 80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585 not found: ID does not exist" containerID="80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"
Jul 29 03:30:23.713175 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.713143    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585"} err="failed to get container status \"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585\": rpc error: code = NotFound desc = could not find container \"80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585\": container with ID starting with 80a62dd10e203e08d2e17c79032670a67ec14e25f576c93c88239b48cea60585 not found: ID does not exist"
Jul 29 03:30:23.718447 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.718422    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:30:23.721904 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.721882    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6174a0-66848479c4-9wbnh"]
Jul 29 03:30:23.734216 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.734187    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:30:23.738106 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:23.738073    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6174a0-6c4945d4cb-lqbjq"]
Jul 29 03:30:24.409626 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:24.409516    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785312a5-2a05-4ac3-9505-5097b23f0d4f" path="/var/lib/kubelet/pods/785312a5-2a05-4ac3-9505-5097b23f0d4f/volumes"
Jul 29 03:30:24.409984 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:24.409901    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ca772e-9ad4-483a-b52b-44fe5248933b" path="/var/lib/kubelet/pods/83ca772e-9ad4-483a-b52b-44fe5248933b/volumes"
Jul 29 03:30:24.410263 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:24.410236    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" path="/var/lib/kubelet/pods/8fb352a6-6fc5-44ab-b4f5-066f14f30971/volumes"
Jul 29 03:30:24.410577 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:24.410564    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" path="/var/lib/kubelet/pods/a9076b71-6354-4e4e-b2b2-0a97ffbf3d42/volumes"
Jul 29 03:30:29.683874 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.683829    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"]
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684210    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ca772e-9ad4-483a-b52b-44fe5248933b" containerName="payload-processing"
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684220    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ca772e-9ad4-483a-b52b-44fe5248933b" containerName="payload-processing"
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" containerName="payload-pre-processing"
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" containerName="payload-pre-processing"
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684263    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" containerName="revoke-keys"
Jul 29 03:30:29.684315 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684269    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" containerName="revoke-keys"
Jul 29 03:30:29.684521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684337    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ca772e-9ad4-483a-b52b-44fe5248933b" containerName="payload-processing"
Jul 29 03:30:29.684521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684344    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9076b71-6354-4e4e-b2b2-0a97ffbf3d42" containerName="revoke-keys"
Jul 29 03:30:29.684521 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.684350    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb352a6-6fc5-44ab-b4f5-066f14f30971" containerName="payload-pre-processing"
Jul 29 03:30:29.688863 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.688841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:29.692049 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.692020    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:30:29.692210 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.692029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:30:29.694582 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.694554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"]
Jul 29 03:30:29.782900 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.782846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq\" (UID: \"73ec1382-b653-4480-a0eb-d9e608f55a77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:29.883621 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.883581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq\" (UID: \"73ec1382-b653-4480-a0eb-d9e608f55a77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:29.884329 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:29.884303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq\" (UID: \"73ec1382-b653-4480-a0eb-d9e608f55a77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:30.002041 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:30.001936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:30.141711 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:30.141679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"]
Jul 29 03:30:30.143517 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:30.143480    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ec1382_b653_4480_a0eb_d9e608f55a77.slice/crio-c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d WatchSource:0}: Error finding container c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d: Status 404 returned error can't find the container with id c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d
Jul 29 03:30:30.738211 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:30.738177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq" event={"ID":"73ec1382-b653-4480-a0eb-d9e608f55a77","Type":"ContainerStarted","Data":"dc8b1c8a88bacb8953c412b0c87abb4808d4aac559e18fd1a46e2492ec9fa5e0"}
Jul 29 03:30:30.738630 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:30.738231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq" event={"ID":"73ec1382-b653-4480-a0eb-d9e608f55a77","Type":"ContainerStarted","Data":"c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d"}
Jul 29 03:30:30.753431 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:30.753367    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq" podStartSLOduration=1.753347957 podStartE2EDuration="1.753347957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:30:30.752659396 +0000 UTC m=+3328.787376085" watchObservedRunningTime="2026-07-29 03:30:30.753347957 +0000 UTC m=+3328.788064648"
Jul 29 03:30:31.746711 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:31.746678    2560 generic.go:356] "Generic (PLEG): container finished" podID="73ec1382-b653-4480-a0eb-d9e608f55a77" containerID="dc8b1c8a88bacb8953c412b0c87abb4808d4aac559e18fd1a46e2492ec9fa5e0" exitCode=0
Jul 29 03:30:31.747196 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:31.746754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq" event={"ID":"73ec1382-b653-4480-a0eb-d9e608f55a77","Type":"ContainerDied","Data":"dc8b1c8a88bacb8953c412b0c87abb4808d4aac559e18fd1a46e2492ec9fa5e0"}
Jul 29 03:30:32.909218 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:32.909192    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:33.011991 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.011904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca\") pod \"73ec1382-b653-4480-a0eb-d9e608f55a77\" (UID: \"73ec1382-b653-4480-a0eb-d9e608f55a77\") "
Jul 29 03:30:33.012339 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.012312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73ec1382-b653-4480-a0eb-d9e608f55a77" (UID: "73ec1382-b653-4480-a0eb-d9e608f55a77"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:33.112687 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.112649    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ec1382-b653-4480-a0eb-d9e608f55a77-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:33.760868 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.760837    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"
Jul 29 03:30:33.761057 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.760883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq" event={"ID":"73ec1382-b653-4480-a0eb-d9e608f55a77","Type":"ContainerDied","Data":"c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d"}
Jul 29 03:30:33.761057 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:33.760961    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c03dca72b4f7603a75cee83f3f2e56cf055b81fe67714f6b01987a2349c07c5d"
Jul 29 03:30:40.131089 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.131027    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"]
Jul 29 03:30:40.133495 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.133470    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4870d-29754930-dhlb4"]
Jul 29 03:30:40.161662 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.161623    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:30:40.161907 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.161883    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" podUID="aac30b71-7337-42a4-a776-94ed6b873042" containerName="payload-processing" containerID="cri-o://6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995" gracePeriod=30
Jul 29 03:30:40.165722 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.165692    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:30:40.166096 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.166069    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" podUID="c51ae385-d29c-4820-8b86-57dfd694344a" containerName="payload-pre-processing" containerID="cri-o://5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333" gracePeriod=30
Jul 29 03:30:40.307900 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.307854    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"]
Jul 29 03:30:40.310949 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.310913    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f4870d-z4zcq"]
Jul 29 03:30:40.409121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.409043    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ec1382-b653-4480-a0eb-d9e608f55a77" path="/var/lib/kubelet/pods/73ec1382-b653-4480-a0eb-d9e608f55a77/volumes"
Jul 29 03:30:40.409477 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.409458    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee6e10b8-f34a-4b3b-b7eb-7097b430abd6" path="/var/lib/kubelet/pods/ee6e10b8-f34a-4b3b-b7eb-7097b430abd6/volumes"
Jul 29 03:30:40.441682 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.441655    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:30:40.443594 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.443573    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:30:40.582387 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582349    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj4cd\" (UniqueName: \"kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd\") pod \"aac30b71-7337-42a4-a776-94ed6b873042\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") "
Jul 29 03:30:40.582598 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8gq7\" (UniqueName: \"kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7\") pod \"c51ae385-d29c-4820-8b86-57dfd694344a\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") "
Jul 29 03:30:40.582598 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume\") pod \"aac30b71-7337-42a4-a776-94ed6b873042\" (UID: \"aac30b71-7337-42a4-a776-94ed6b873042\") "
Jul 29 03:30:40.582598 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582491    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume\") pod \"c51ae385-d29c-4820-8b86-57dfd694344a\" (UID: \"c51ae385-d29c-4820-8b86-57dfd694344a\") "
Jul 29 03:30:40.582876 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582853    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c51ae385-d29c-4820-8b86-57dfd694344a" (UID: "c51ae385-d29c-4820-8b86-57dfd694344a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:40.582932 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.582874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aac30b71-7337-42a4-a776-94ed6b873042" (UID: "aac30b71-7337-42a4-a776-94ed6b873042"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:40.584679 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.584658    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd" (OuterVolumeSpecName: "kube-api-access-zj4cd") pod "aac30b71-7337-42a4-a776-94ed6b873042" (UID: "aac30b71-7337-42a4-a776-94ed6b873042"). InnerVolumeSpecName "kube-api-access-zj4cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:40.584679 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.584667    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7" (OuterVolumeSpecName: "kube-api-access-t8gq7") pod "c51ae385-d29c-4820-8b86-57dfd694344a" (UID: "c51ae385-d29c-4820-8b86-57dfd694344a"). InnerVolumeSpecName "kube-api-access-t8gq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:40.683944 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.683900    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c51ae385-d29c-4820-8b86-57dfd694344a-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:40.683944 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.683935    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj4cd\" (UniqueName: \"kubernetes.io/projected/aac30b71-7337-42a4-a776-94ed6b873042-kube-api-access-zj4cd\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:40.683944 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.683945    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8gq7\" (UniqueName: \"kubernetes.io/projected/c51ae385-d29c-4820-8b86-57dfd694344a-kube-api-access-t8gq7\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:40.683944 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.683953    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac30b71-7337-42a4-a776-94ed6b873042-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:40.802926 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.802890    2560 generic.go:356] "Generic (PLEG): container finished" podID="c51ae385-d29c-4820-8b86-57dfd694344a" containerID="5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333" exitCode=0
Jul 29 03:30:40.803128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.802943    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"
Jul 29 03:30:40.803128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.802978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" event={"ID":"c51ae385-d29c-4820-8b86-57dfd694344a","Type":"ContainerDied","Data":"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"}
Jul 29 03:30:40.803128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.803035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr" event={"ID":"c51ae385-d29c-4820-8b86-57dfd694344a","Type":"ContainerDied","Data":"9b2e567cfc76df1c78fe3d133dabf9363be4258aeb2da0d92fa277c6eeaf6cdd"}
Jul 29 03:30:40.803128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.803066    2560 scope.go:117] "RemoveContainer" containerID="5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"
Jul 29 03:30:40.804302 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.804278    2560 generic.go:356] "Generic (PLEG): container finished" podID="aac30b71-7337-42a4-a776-94ed6b873042" containerID="6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995" exitCode=0
Jul 29 03:30:40.804405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.804325    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"
Jul 29 03:30:40.804405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.804367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" event={"ID":"aac30b71-7337-42a4-a776-94ed6b873042","Type":"ContainerDied","Data":"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"}
Jul 29 03:30:40.804495 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.804410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c" event={"ID":"aac30b71-7337-42a4-a776-94ed6b873042","Type":"ContainerDied","Data":"c46293b054d129566004d8bc6ae756dbec4717811bf5f470a9fb70df0a604cc9"}
Jul 29 03:30:40.812218 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.812200    2560 scope.go:117] "RemoveContainer" containerID="5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"
Jul 29 03:30:40.812861 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:30:40.812830    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333\": container with ID starting with 5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333 not found: ID does not exist" containerID="5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"
Jul 29 03:30:40.812986 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.812869    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333"} err="failed to get container status \"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333\": rpc error: code = NotFound desc = could not find container \"5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333\": container with ID starting with 5f07e4acf0972843fcfcaaba909b6d5499dfdc2bbc0a70efa77d105f5e2fe333 not found: ID does not exist"
Jul 29 03:30:40.812986 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.812889    2560 scope.go:117] "RemoveContainer" containerID="6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"
Jul 29 03:30:40.821740 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.821723    2560 scope.go:117] "RemoveContainer" containerID="6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"
Jul 29 03:30:40.822043 ip-10-0-133-22 kubenswrapper[2560]: E0729 03:30:40.822021    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995\": container with ID starting with 6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995 not found: ID does not exist" containerID="6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"
Jul 29 03:30:40.822091 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.822051    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995"} err="failed to get container status \"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995\": rpc error: code = NotFound desc = could not find container \"6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995\": container with ID starting with 6954f55583a119d5bd2d86548786499fa8152bcfd77bdacced75d519423a0995 not found: ID does not exist"
Jul 29 03:30:40.828980 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.828957    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:30:40.835442 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.835417    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4870d-7f869b5bdb-9w78c"]
Jul 29 03:30:40.846737 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.846702    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:30:40.848946 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:40.848925    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4870d-7654549bdd-sjvvr"]
Jul 29 03:30:42.407531 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:42.407492    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac30b71-7337-42a4-a776-94ed6b873042" path="/var/lib/kubelet/pods/aac30b71-7337-42a4-a776-94ed6b873042/volumes"
Jul 29 03:30:42.408032 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:42.408013    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51ae385-d29c-4820-8b86-57dfd694344a" path="/var/lib/kubelet/pods/c51ae385-d29c-4820-8b86-57dfd694344a/volumes"
Jul 29 03:30:47.085772 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.085728    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"]
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086093    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac30b71-7337-42a4-a776-94ed6b873042" containerName="payload-processing"
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086104    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac30b71-7337-42a4-a776-94ed6b873042" containerName="payload-processing"
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086115    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51ae385-d29c-4820-8b86-57dfd694344a" containerName="payload-pre-processing"
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086121    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51ae385-d29c-4820-8b86-57dfd694344a" containerName="payload-pre-processing"
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086135    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ec1382-b653-4480-a0eb-d9e608f55a77" containerName="revoke-keys"
Jul 29 03:30:47.086164 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086141    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ec1382-b653-4480-a0eb-d9e608f55a77" containerName="revoke-keys"
Jul 29 03:30:47.086404 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086221    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51ae385-d29c-4820-8b86-57dfd694344a" containerName="payload-pre-processing"
Jul 29 03:30:47.086404 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086232    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ec1382-b653-4480-a0eb-d9e608f55a77" containerName="revoke-keys"
Jul 29 03:30:47.086404 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.086257    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac30b71-7337-42a4-a776-94ed6b873042" containerName="payload-processing"
Jul 29 03:30:47.089546 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.089524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:47.092130 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.092102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w57ct\""
Jul 29 03:30:47.092298 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.092190    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:30:47.096643 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.096618    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"]
Jul 29 03:30:47.244819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.244777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-19184d-fvw77\" (UID: \"039db127-7dfc-49ad-9496-be15e84b7587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:47.345462 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.345361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-19184d-fvw77\" (UID: \"039db127-7dfc-49ad-9496-be15e84b7587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:47.345997 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.345975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-19184d-fvw77\" (UID: \"039db127-7dfc-49ad-9496-be15e84b7587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:47.401613 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.401580    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:47.536648 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.536615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"]
Jul 29 03:30:47.537187 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:30:47.537162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039db127_7dfc_49ad_9496_be15e84b7587.slice/crio-aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67 WatchSource:0}: Error finding container aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67: Status 404 returned error can't find the container with id aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67
Jul 29 03:30:47.846719 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:47.846685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77" event={"ID":"039db127-7dfc-49ad-9496-be15e84b7587","Type":"ContainerStarted","Data":"aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67"}
Jul 29 03:30:48.854138 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:48.854100    2560 generic.go:356] "Generic (PLEG): container finished" podID="039db127-7dfc-49ad-9496-be15e84b7587" containerID="fb4631c2a6a379ac87d77ff8d45575cf35a2a899b5489fcba2a44b005a0778cd" exitCode=0
Jul 29 03:30:48.854610 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:48.854189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77" event={"ID":"039db127-7dfc-49ad-9496-be15e84b7587","Type":"ContainerDied","Data":"fb4631c2a6a379ac87d77ff8d45575cf35a2a899b5489fcba2a44b005a0778cd"}
Jul 29 03:30:49.992623 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:49.992598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:50.070003 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.069971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca\") pod \"039db127-7dfc-49ad-9496-be15e84b7587\" (UID: \"039db127-7dfc-49ad-9496-be15e84b7587\") "
Jul 29 03:30:50.070405 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.070382    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "039db127-7dfc-49ad-9496-be15e84b7587" (UID: "039db127-7dfc-49ad-9496-be15e84b7587"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:50.170715 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.170620    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039db127-7dfc-49ad-9496-be15e84b7587-maas-api-service-ca\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:50.867404 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.867370    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"
Jul 29 03:30:50.867604 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.867423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77" event={"ID":"039db127-7dfc-49ad-9496-be15e84b7587","Type":"ContainerDied","Data":"aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67"}
Jul 29 03:30:50.867604 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:50.867480    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa8a347558aab66f35e41a1a264e0efe1f4696c0cbfd311e04f150998534de67"
Jul 29 03:30:57.666254 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.666213    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"]
Jul 29 03:30:57.669819 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.669790    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19184d-29754930-hh6jq"]
Jul 29 03:30:57.701256 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.701206    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:30:57.701522 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.701492    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerName="payload-processing" containerID="cri-o://76bf1c4647bce781019bbb5857c4ef3f7ee6877e22b9f1b3be2cd53bb1fed8ec" gracePeriod=30
Jul 29 03:30:57.709566 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.709534    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:30:57.711699 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.711646    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerName="payload-pre-processing" containerID="cri-o://429e32c38b748064446481262ddb144ecda7d38b25ec2c50cabc69dd17af9a80" gracePeriod=30
Jul 29 03:30:57.847925 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.847779    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"]
Jul 29 03:30:57.852162 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.852119    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-19184d-fvw77"]
Jul 29 03:30:57.914263 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.914211    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerID="429e32c38b748064446481262ddb144ecda7d38b25ec2c50cabc69dd17af9a80" exitCode=0
Jul 29 03:30:57.914430 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.914285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" event={"ID":"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98","Type":"ContainerDied","Data":"429e32c38b748064446481262ddb144ecda7d38b25ec2c50cabc69dd17af9a80"}
Jul 29 03:30:57.916677 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.916589    2560 generic.go:356] "Generic (PLEG): container finished" podID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerID="76bf1c4647bce781019bbb5857c4ef3f7ee6877e22b9f1b3be2cd53bb1fed8ec" exitCode=0
Jul 29 03:30:57.916817 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.916681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" event={"ID":"80fc0651-fcda-447d-adc5-5a2a36e75013","Type":"ContainerDied","Data":"76bf1c4647bce781019bbb5857c4ef3f7ee6877e22b9f1b3be2cd53bb1fed8ec"}
Jul 29 03:30:57.985823 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.985794    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:30:57.988544 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:57.988524    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:30:58.141993 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.141951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume\") pod \"80fc0651-fcda-447d-adc5-5a2a36e75013\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") "
Jul 29 03:30:58.141993 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.141988    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume\") pod \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") "
Jul 29 03:30:58.142287 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.142021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dj67\" (UniqueName: \"kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67\") pod \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\" (UID: \"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98\") "
Jul 29 03:30:58.142287 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.142047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpvqs\" (UniqueName: \"kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs\") pod \"80fc0651-fcda-447d-adc5-5a2a36e75013\" (UID: \"80fc0651-fcda-447d-adc5-5a2a36e75013\") "
Jul 29 03:30:58.142472 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.142450    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80fc0651-fcda-447d-adc5-5a2a36e75013" (UID: "80fc0651-fcda-447d-adc5-5a2a36e75013"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:58.142472 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.142459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" (UID: "9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:58.144208 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.144188    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67" (OuterVolumeSpecName: "kube-api-access-4dj67") pod "9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" (UID: "9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98"). InnerVolumeSpecName "kube-api-access-4dj67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:58.144275 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.144209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs" (OuterVolumeSpecName: "kube-api-access-rpvqs") pod "80fc0651-fcda-447d-adc5-5a2a36e75013" (UID: "80fc0651-fcda-447d-adc5-5a2a36e75013"). InnerVolumeSpecName "kube-api-access-rpvqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:58.242961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.242914    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpvqs\" (UniqueName: \"kubernetes.io/projected/80fc0651-fcda-447d-adc5-5a2a36e75013-kube-api-access-rpvqs\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:58.242961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.242952    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fc0651-fcda-447d-adc5-5a2a36e75013-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:58.242961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.242962    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-plugins-config-volume\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:58.242961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.242970    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dj67\" (UniqueName: \"kubernetes.io/projected/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98-kube-api-access-4dj67\") on node \"ip-10-0-133-22.ec2.internal\" DevicePath \"\""
Jul 29 03:30:58.408616 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.408582    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="039db127-7dfc-49ad-9496-be15e84b7587" path="/var/lib/kubelet/pods/039db127-7dfc-49ad-9496-be15e84b7587/volumes"
Jul 29 03:30:58.408884 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.408871    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c239a412-704f-4692-9efb-9e83fcb02a58" path="/var/lib/kubelet/pods/c239a412-704f-4692-9efb-9e83fcb02a58/volumes"
Jul 29 03:30:58.924128 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.924096    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"
Jul 29 03:30:58.924652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.924119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" event={"ID":"9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98","Type":"ContainerDied","Data":"f2327191f88fff8a5c286b1b2c97ab1374a6028581d01988a3446885d8052d89"}
Jul 29 03:30:58.924652 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.924219    2560 scope.go:117] "RemoveContainer" containerID="429e32c38b748064446481262ddb144ecda7d38b25ec2c50cabc69dd17af9a80"
Jul 29 03:30:58.925609 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.925586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" event={"ID":"80fc0651-fcda-447d-adc5-5a2a36e75013","Type":"ContainerDied","Data":"5c369c42ebd53f75bad2dc2e5c697fadf9b62e091f226fae7e937874b4bb77b1"}
Jul 29 03:30:58.925682 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.925622    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"
Jul 29 03:30:58.933988 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.933968    2560 scope.go:117] "RemoveContainer" containerID="76bf1c4647bce781019bbb5857c4ef3f7ee6877e22b9f1b3be2cd53bb1fed8ec"
Jul 29 03:30:58.942660 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.942627    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:30:58.944883 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.944862    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm"]
Jul 29 03:30:58.955444 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.955402    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:30:58.957510 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.957483    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw"]
Jul 29 03:30:58.964008 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.963978    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-19184d-768b56cfc4-2bkcw" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.77:9004: i/o timeout"
Jul 29 03:30:58.964119 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:30:58.963999    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-19184d-747b6f7d8-dfwxm" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.76:9004: i/o timeout"
Jul 29 03:31:00.408300 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:00.408263    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" path="/var/lib/kubelet/pods/80fc0651-fcda-447d-adc5-5a2a36e75013/volumes"
Jul 29 03:31:00.408702 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:00.408625    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" path="/var/lib/kubelet/pods/9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98/volumes"
Jul 29 03:31:03.144688 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:03.144656    2560 scope.go:117] "RemoveContainer" containerID="7ffc5585a7d3d18e60d6defdfdd1f37d6970cf620f33b75c6f43263d462c2c33"
Jul 29 03:31:11.073505 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:11.073471    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-9m9lt_6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86/copy-manifests/0.log"
Jul 29 03:31:11.088469 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:11.088439    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-9m9lt_6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86/manager/0.log"
Jul 29 03:31:11.685108 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:11.685076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754900-sl42p_6fa04587-aa93-4d0d-8458-a965f5a27d13/cleanup/0.log"
Jul 29 03:31:11.800140 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:11.800109    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754915-47mxc_666d8606-04f0-445c-bd91-871a7a622abc/cleanup/0.log"
Jul 29 03:31:11.919537 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:11.919510    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754930-52wgq_927a836a-12af-465d-8af8-957122571c37/cleanup/0.log"
Jul 29 03:31:12.816994 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.816963    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/util/0.log"
Jul 29 03:31:12.822967 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.822946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/pull/0.log"
Jul 29 03:31:12.828509 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.828490    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/extract/0.log"
Jul 29 03:31:12.935027 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.934999    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/util/0.log"
Jul 29 03:31:12.940396 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.940373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/pull/0.log"
Jul 29 03:31:12.945952 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:12.945925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/extract/0.log"
Jul 29 03:31:13.055287 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.055229    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/util/0.log"
Jul 29 03:31:13.061533 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.061510    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/pull/0.log"
Jul 29 03:31:13.067936 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.067861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/extract/0.log"
Jul 29 03:31:13.179723 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.179693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/pull/0.log"
Jul 29 03:31:13.185287 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.185241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/extract/0.log"
Jul 29 03:31:13.190763 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:13.190742    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/util/0.log"
Jul 29 03:31:14.134650 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:14.134620    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dlsh8_89cd3f42-028c-4485-8dd2-00bb18fb0968/manager/0.log"
Jul 29 03:31:14.599560 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:14.599531    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c27v8_51ed7887-aa12-4918-8999-b90d019d710a/discovery/0.log"
Jul 29 03:31:15.071121 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:15.071082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mschr_6c6aae45-6b6a-4406-b7b9-705475b432a5/payload-pre-processing/0.log"
Jul 29 03:31:15.319903 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:15.319875    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f7bcd7cf-nm5fw_f4304694-f029-4ca7-b683-7c37bf5b4429/router/0.log"
Jul 29 03:31:15.687188 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:15.687162    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7fvjr_b20aa0b2-bb5b-4a29-8bd4-8fa779409a55/main/0.log"
Jul 29 03:31:16.038910 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:16.038838    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhccrl_8f0c856e-c4d0-4488-a01a-9f38e3184bdc/main/0.log"
Jul 29 03:31:25.083932 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:25.083893    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mb46c_5bebd31d-8134-4583-8ad5-97814390926a/global-pull-secret-syncer/0.log"
Jul 29 03:31:25.163234 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:25.163187    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qn7xt_76e74d80-83b7-4d24-80fa-68a248ee9dd9/konnectivity-agent/0.log"
Jul 29 03:31:25.234552 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:25.234519    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-22.ec2.internal_a5e7892a7e323d603c3a013f4adfb322/haproxy/0.log"
Jul 29 03:31:30.019690 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.019663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/extract/0.log"
Jul 29 03:31:30.042347 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.042316    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/util/0.log"
Jul 29 03:31:30.062700 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.062671    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbmbv_284c354c-3de1-4142-b8b8-251a561fb916/pull/0.log"
Jul 29 03:31:30.090168 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.090133    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/extract/0.log"
Jul 29 03:31:30.108927 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.108897    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/util/0.log"
Jul 29 03:31:30.128309 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.128277    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07fmn6_e4bb4af8-f93f-4f48-a3cb-b84ac4d0cf1c/pull/0.log"
Jul 29 03:31:30.152958 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.152927    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/extract/0.log"
Jul 29 03:31:30.174458 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.174432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/util/0.log"
Jul 29 03:31:30.194104 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.194075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739v27l_f746c68e-ec57-43b5-aa71-b2976e6ba094/pull/0.log"
Jul 29 03:31:30.220575 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.220552    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/extract/0.log"
Jul 29 03:31:30.241645 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.241619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/util/0.log"
Jul 29 03:31:30.262753 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:30.262721    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fkmw5_ffb57b22-753c-476e-9524-6eb0249e3a7f/pull/0.log"
Jul 29 03:31:31.413648 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:31.413611    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dlsh8_89cd3f42-028c-4485-8dd2-00bb18fb0968/manager/0.log"
Jul 29 03:31:33.194975 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.194929    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-46nbd_f497a683-8dce-456e-9940-3a9728fb3c5b/cluster-monitoring-operator/0.log"
Jul 29 03:31:33.344262 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.344224    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmp92_eb688823-a86b-47ec-9382-4bc4d5a9646b/node-exporter/0.log"
Jul 29 03:31:33.368205 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.368177    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmp92_eb688823-a86b-47ec-9382-4bc4d5a9646b/kube-rbac-proxy/0.log"
Jul 29 03:31:33.388069 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.388042    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmp92_eb688823-a86b-47ec-9382-4bc4d5a9646b/init-textfile/0.log"
Jul 29 03:31:33.866972 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.866943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9694bccf-zc8xv_d82bb253-6b0b-4bbb-9122-9089751b4646/telemeter-client/0.log"
Jul 29 03:31:33.893908 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.893882    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9694bccf-zc8xv_d82bb253-6b0b-4bbb-9122-9089751b4646/reload/0.log"
Jul 29 03:31:33.914380 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:33.914351    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9694bccf-zc8xv_d82bb253-6b0b-4bbb-9122-9089751b4646/kube-rbac-proxy/0.log"
Jul 29 03:31:35.159229 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.159199    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-c2rhv_de8c8728-ec25-4ae7-ba7c-c80c12bb671b/networking-console-plugin/0.log"
Jul 29 03:31:35.412696 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412607    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"]
Jul 29 03:31:35.412935 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412923    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerName="payload-processing"
Jul 29 03:31:35.412977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412936    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerName="payload-processing"
Jul 29 03:31:35.412977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412955    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerName="payload-pre-processing"
Jul 29 03:31:35.412977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412961    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerName="payload-pre-processing"
Jul 29 03:31:35.412977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412971    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039db127-7dfc-49ad-9496-be15e84b7587" containerName="revoke-keys"
Jul 29 03:31:35.412977 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.412977    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="039db127-7dfc-49ad-9496-be15e84b7587" containerName="revoke-keys"
Jul 29 03:31:35.413148 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.413037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce45a6f-bc50-4a6d-bc51-e99cb9d36c98" containerName="payload-pre-processing"
Jul 29 03:31:35.413148 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.413045    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80fc0651-fcda-447d-adc5-5a2a36e75013" containerName="payload-processing"
Jul 29 03:31:35.413148 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.413053    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="039db127-7dfc-49ad-9496-be15e84b7587" containerName="revoke-keys"
Jul 29 03:31:35.416351 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.416333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.418961 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.418929    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j9bk\"/\"openshift-service-ca.crt\""
Jul 29 03:31:35.420200 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.420174    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2j9bk\"/\"default-dockercfg-mbphh\""
Jul 29 03:31:35.420351 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.420219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j9bk\"/\"kube-root-ca.crt\""
Jul 29 03:31:35.425711 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.425677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"]
Jul 29 03:31:35.534455 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.534417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-proc\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.534455 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.534461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-lib-modules\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.534714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.534499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf74n\" (UniqueName: \"kubernetes.io/projected/d4d438a0-6351-4a36-a6e1-40967dff3f37-kube-api-access-zf74n\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.534714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.534544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-podres\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.534714 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.534586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-sys\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-proc\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635280 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-lib-modules\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf74n\" (UniqueName: \"kubernetes.io/projected/d4d438a0-6351-4a36-a6e1-40967dff3f37-kube-api-access-zf74n\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-podres\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-proc\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-sys\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-podres\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-sys\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.635547 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.635484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d438a0-6351-4a36-a6e1-40967dff3f37-lib-modules\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.643241 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.643218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf74n\" (UniqueName: \"kubernetes.io/projected/d4d438a0-6351-4a36-a6e1-40967dff3f37-kube-api-access-zf74n\") pod \"perf-node-gather-daemonset-x4h48\" (UID: \"d4d438a0-6351-4a36-a6e1-40967dff3f37\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.727130 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.727091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:35.792287 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.792239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/1.log"
Jul 29 03:31:35.802899 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.801445    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-lc687_7a747d4e-0878-4732-8e2a-18e8c8c955b8/console-operator/2.log"
Jul 29 03:31:35.868927 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:35.868898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"]
Jul 29 03:31:35.870629 ip-10-0-133-22 kubenswrapper[2560]: W0729 03:31:35.870597    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4d438a0_6351_4a36_a6e1_40967dff3f37.slice/crio-15461cef8f7a4c9a503d91d58d604ba1ca56f3a2ec8d84f444dce673d9d27182 WatchSource:0}: Error finding container 15461cef8f7a4c9a503d91d58d604ba1ca56f3a2ec8d84f444dce673d9d27182: Status 404 returned error can't find the container with id 15461cef8f7a4c9a503d91d58d604ba1ca56f3a2ec8d84f444dce673d9d27182
Jul 29 03:31:36.137792 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:36.137755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48" event={"ID":"d4d438a0-6351-4a36-a6e1-40967dff3f37","Type":"ContainerStarted","Data":"727ccb4726321c8c24b0a64fd22210ec45d7c032e0e5141398cb0cc72ae679ca"}
Jul 29 03:31:36.138016 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:36.137815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48" event={"ID":"d4d438a0-6351-4a36-a6e1-40967dff3f37","Type":"ContainerStarted","Data":"15461cef8f7a4c9a503d91d58d604ba1ca56f3a2ec8d84f444dce673d9d27182"}
Jul 29 03:31:36.138016 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:36.137875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:36.154043 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:36.153992    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48" podStartSLOduration=1.153974649 podStartE2EDuration="1.153974649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:31:36.152449653 +0000 UTC m=+3394.187166347" watchObservedRunningTime="2026-07-29 03:31:36.153974649 +0000 UTC m=+3394.188691336"
Jul 29 03:31:36.919432 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:36.919403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-nld9d_1a4686e8-c644-4409-9b9a-56d2bf89cb3a/volume-data-source-validator/0.log"
Jul 29 03:31:37.923906 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:37.923875    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pjnm_78da0e9a-4047-4386-b822-31cb5f3b709f/dns/0.log"
Jul 29 03:31:37.944029 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:37.944003    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pjnm_78da0e9a-4047-4386-b822-31cb5f3b709f/kube-rbac-proxy/0.log"
Jul 29 03:31:38.102309 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:38.102283    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hq6x5_5091c187-14d2-4ebb-b931-49cb63365f28/dns-node-resolver/0.log"
Jul 29 03:31:38.678039 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:38.678007    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrkjw_5f39cb20-4dbb-49f1-a882-7706c7db1259/node-ca/0.log"
Jul 29 03:31:39.754524 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:39.754492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c27v8_51ed7887-aa12-4918-8999-b90d019d710a/discovery/0.log"
Jul 29 03:31:39.925126 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:39.925083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mschr_6c6aae45-6b6a-4406-b7b9-705475b432a5/payload-pre-processing/0.log"
Jul 29 03:31:39.983841 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:39.983811    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f7bcd7cf-nm5fw_f4304694-f029-4ca7-b683-7c37bf5b4429/router/0.log"
Jul 29 03:31:40.845840 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:40.845814    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wst4g_778c18ab-e223-42e4-aa27-eebba3ec33df/serve-healthcheck-canary/0.log"
Jul 29 03:31:41.327995 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:41.327925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-l9tw4_01daba41-2f6a-4416-a2d5-b5ecea850aa2/insights-operator/0.log"
Jul 29 03:31:41.328847 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:41.328829    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-l9tw4_01daba41-2f6a-4416-a2d5-b5ecea850aa2/insights-operator/1.log"
Jul 29 03:31:41.347871 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:41.347846    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfnd_2cd022d7-bd48-44a5-ac54-2523a2ef9ba9/kube-rbac-proxy/0.log"
Jul 29 03:31:41.368098 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:41.368070    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfnd_2cd022d7-bd48-44a5-ac54-2523a2ef9ba9/exporter/0.log"
Jul 29 03:31:41.386738 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:41.386714    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfnd_2cd022d7-bd48-44a5-ac54-2523a2ef9ba9/extractor/0.log"
Jul 29 03:31:42.153659 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:42.153633    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-x4h48"
Jul 29 03:31:44.528574 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:44.528537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-9m9lt_6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86/manager/0.log"
Jul 29 03:31:44.544523 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:44.544493    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-9m9lt_6837fe5f-4f10-41df-b9d5-6ebbaf0a3c86/copy-manifests/0.log"
Jul 29 03:31:45.939378 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:45.939336    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64f48568bd-92jx4_a7210337-a63b-4b1b-9868-a7cb07ff4d29/manager/0.log"
Jul 29 03:31:46.064264 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:46.064203    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c27v8_51ed7887-aa12-4918-8999-b90d019d710a/discovery/0.log"
Jul 29 03:31:46.211042 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:46.210949    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mschr_6c6aae45-6b6a-4406-b7b9-705475b432a5/payload-pre-processing/0.log"
Jul 29 03:31:46.257726 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:46.257697    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f7bcd7cf-nm5fw_f4304694-f029-4ca7-b683-7c37bf5b4429/router/0.log"
Jul 29 03:31:47.766978 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:47.766948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c27v8_51ed7887-aa12-4918-8999-b90d019d710a/discovery/0.log"
Jul 29 03:31:47.887442 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:47.887354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mschr_6c6aae45-6b6a-4406-b7b9-705475b432a5/payload-pre-processing/0.log"
Jul 29 03:31:47.951029 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:47.951001    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f7bcd7cf-nm5fw_f4304694-f029-4ca7-b683-7c37bf5b4429/router/0.log"
Jul 29 03:31:51.470705 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:51.470664    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z282s_e904d051-def7-468b-85e5-5aa470c9c79b/kube-storage-version-migrator-operator/1.log"
Jul 29 03:31:51.471568 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:51.471546    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z282s_e904d051-def7-468b-85e5-5aa470c9c79b/kube-storage-version-migrator-operator/0.log"
Jul 29 03:31:52.442447 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.442419    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/kube-multus-additional-cni-plugins/0.log"
Jul 29 03:31:52.466861 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.466831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/egress-router-binary-copy/0.log"
Jul 29 03:31:52.486516 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.486486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/cni-plugins/0.log"
Jul 29 03:31:52.505391 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.505364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/bond-cni-plugin/0.log"
Jul 29 03:31:52.524618 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.524589    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/routeoverride-cni/0.log"
Jul 29 03:31:52.543672 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.543644    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/whereabouts-cni-bincopy/0.log"
Jul 29 03:31:52.562168 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.562140    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wcgm_63dd1e50-95f4-4e85-87e8-6ea09cea9d35/whereabouts-cni/0.log"
Jul 29 03:31:52.942693 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.942663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t55n8_17fca31d-0d72-4dd2-8c5b-55a817ecaa14/kube-multus/0.log"
Jul 29 03:31:52.997835 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:52.997802    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-29x8f_fceadac6-9c8c-422e-990b-3af17d36c589/network-metrics-daemon/0.log"
Jul 29 03:31:53.015950 ip-10-0-133-22 kubenswrapper[2560]: I0729 03:31:53.015912    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-29x8f_fceadac6-9c8c-422e-990b-3af17d36c589/kube-rbac-proxy/0.log"