Jul 29 01:10:09.860921 ip-10-0-133-32 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:10:10.202844 ip-10-0-133-32 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:10.202844 ip-10-0-133-32 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:10:10.202844 ip-10-0-133-32 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:10.202844 ip-10-0-133-32 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:10:10.202844 ip-10-0-133-32 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:10.205008 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.204886    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:10:10.208799 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208771    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.208799 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208796    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.208799 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208801    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.208799 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208806    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208810    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208815    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208819    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208824    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208828    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208832    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208835    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208844    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208849    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208852    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208856    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208861    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208864    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208869    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208881    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208886    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208890    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208894    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208899    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.209039 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208903    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208912    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208916    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208921    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208925    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208930    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208937    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208943    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208947    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208952    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208959    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208965    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208971    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208982    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208988    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.208996    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209001    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209007    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209012    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.209842 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209017    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209022    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209029    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209035    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209041    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209051    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209056    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209062    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209067    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209073    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209079    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209084    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209089    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209094    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209098    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209103    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209107    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209112    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209121    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209125    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.210393 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209130    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209134    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209139    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209143    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209147    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209152    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209157    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209166    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209170    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209175    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209186    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209191    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209196    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209200    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209205    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209209    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209214    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209219    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209224    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209228    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.211270 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209233    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209237    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209248    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209253    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209258    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209262    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209266    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209270    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209275    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209280    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209284    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209289    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209293    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209298    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209302    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209312    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.209317    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211552    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211565    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211570    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.212126 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211594    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211599    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211603    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211608    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211612    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211618    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211622    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211628    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211633    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211637    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211642    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211645    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211649    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211654    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211658    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211663    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211667    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211671    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211675    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.213018 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211680    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211684    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211688    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211693    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211697    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211701    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211705    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211711    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211715    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211719    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211723    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211727    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211731    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211735    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211740    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211744    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211748    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211752    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211756    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211760    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.213921 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211765    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211769    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211774    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211778    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211782    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211786    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211791    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211795    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211799    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211803    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211807    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211811    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211816    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211820    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211824    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211830    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211836    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211841    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211845    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.214804 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211849    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211853    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211860    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211866    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211871    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211876    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211881    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211886    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211891    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211896    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211900    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211906    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211910    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211914    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211918    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211922    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211927    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211930    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211935    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211939    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.215285 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211943    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211948    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211953    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211958    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211962    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211966    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211970    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211974    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211980    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211986    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211991    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.211996    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212001    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212006    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212010    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212014    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212018    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212023    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212685    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.215918 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212693    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212698    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212704    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212708    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212713    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212717    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212721    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212725    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212730    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212734    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212740    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212746    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212751    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212755    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212759    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212765    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212770    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212774    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212778    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.216600 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212782    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212787    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212791    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212796    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212800    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212804    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212809    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212813    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212817    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212821    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212826    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212830    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212834    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212839    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212843    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212847    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212851    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212855    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212859    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212863    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.217116 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212867    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212875    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212879    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212883    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212890    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212897    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212903    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212910    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212915    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212922    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212927    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212931    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212935    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212940    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212944    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212948    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212953    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212957    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212960    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.217685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212965    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212970    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212974    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212978    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212985    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212989    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212994    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.212998    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213002    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213006    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213010    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213014    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213018    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213021    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213025    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213028    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213033    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213037    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213041    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213045    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.218222 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213049    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213053    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213057    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213062    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213066    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213073    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213077    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213081    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213086    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213090    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213095    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213099    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213103    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213107    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213111    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213115    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213120    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213125    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213128    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.213132    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.218781 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213239    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213252    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213265    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213272    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213278    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213283    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213290    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213297    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213302    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213306    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213312    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213317    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213322    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213326    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213331    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213336    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213341    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213346    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213354    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213358    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213363    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213368    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213374    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213380    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:10:10.219267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213384    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213389    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213395    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213399    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213406    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213411    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213415    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213420    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213426    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213431    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213436    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213440    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213445    2578 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213450    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213457    2578 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213461    2578 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213466    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213470    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213475    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213481    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213486    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213490    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213495    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213499    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213504    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:10:10.219860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213509    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213514    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213519    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213524    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213529    2578 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213535    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213539    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213544    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213548    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213553    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213558    2578 flags.go:64] FLAG: --help="false"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213565    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213604    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213610    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213616    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213622    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213627    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213633    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213637    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213642    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213647    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213651    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213656    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213661    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:10:10.220497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213665    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213670    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213676    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213681    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213685    2578 flags.go:64] FLAG: --lock-file=""
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213690    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213694    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213699    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213708    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213717    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213722    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213731    2578 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213736    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213741    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213746    2578 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213750    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213757    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213761    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213768    2578 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213775    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213780    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213784    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213789    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213794    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213798    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:10:10.221261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213803    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213816    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213821    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213826    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213830    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213835    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213844    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213848    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213853    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213858    2578 flags.go:64] FLAG: --port="10250"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213863    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213868    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f1680144f6066c1"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213873    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213878    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213883    2578 flags.go:64] FLAG: --register-node="true"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213888    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213894    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213900    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213905    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213912    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213917    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213922    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213927    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213931    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213936    2578 flags.go:64] FLAG: --runonce="false"
Jul 29 01:10:10.221905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213940    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213946    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213950    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213955    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213959    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213965    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213969    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213974    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213979    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213983    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213988    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213993    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.213998    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214003    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214007    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214016    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214020    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214024    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214033    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214037    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214042    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214047    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214051    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214056    2578 flags.go:64] FLAG: --v="2"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214063    2578 flags.go:64] FLAG: --version="false"
Jul 29 01:10:10.222531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214070    2578 flags.go:64] FLAG: --vmodule=""
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214078    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.214084    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214289    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214296    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214301    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214305    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214311    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214315    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214320    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214324    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214328    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214333    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214337    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214341    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214346    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214350    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214354    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214358    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214363    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.223154 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214366    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214370    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214375    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214379    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214383    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214387    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214391    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214395    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214399    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214403    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214407    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214411    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214415    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214422    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214426    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214430    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214433    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214438    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214441    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.223672 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214448    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214465    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214471    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214476    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214481    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214485    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214489    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214494    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214498    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214502    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214507    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214511    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214516    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214521    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214526    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214530    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214534    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214539    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214543    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214548    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.224158 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214552    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214556    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214560    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214564    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214568    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214592    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214601    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214605    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214610    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214614    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214618    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214623    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214627    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214631    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214636    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214641    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214644    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214648    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214653    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214657    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.224656 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214661    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214670    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214675    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214679    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214685    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214691    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214697    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214701    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214706    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214710    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214714    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214718    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214722    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214727    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214731    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214737    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214743    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214747    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214752    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.225208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214756    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214762    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214766    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.214770    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.215258    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.222781    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.222807    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.222829    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.222835    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222895    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222900    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222903    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222907    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222910    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222912    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.225767 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222915    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222919    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222921    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222924    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222926    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222929    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222931    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222934    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222937    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222939    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222942    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222945    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222948    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222952    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222955    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222958    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222960    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222963    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222966    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.226148 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222969    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222972    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222974    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222977    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222981    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222984    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222986    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222991    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222994    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.222997    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223000    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223003    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223006    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223009    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223011    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223014    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223016    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223019    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223021    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.226640 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223023    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223026    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223028    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223031    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223033    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223036    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223038    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223040    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223043    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223046    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223049    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223052    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223054    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223057    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223059    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223062    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223065    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223069    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223075    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223077    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.227101 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223080    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223082    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223085    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223087    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223090    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223092    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223094    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223097    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223099    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223102    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223104    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223106    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223110    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223113    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223115    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223117    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223120    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223122    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223125    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223127    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.227648 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223129    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223133    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223136    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223138    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223141    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223143    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223146    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223149    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223151    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223153    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223156    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223159    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223162    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223166    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223169    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.228137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.223175    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223296    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223301    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223304    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223307    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223309    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223312    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223314    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223317    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223320    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223322    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223325    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223328    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223330    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223332    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223335    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223337    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223339    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223342    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223345    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:10.228510 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223347    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223350    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223352    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223354    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223357    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223359    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223361    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223364    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223367    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223373    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223376    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223379    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223382    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223385    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223387    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223390    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223392    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223395    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223397    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:10.229083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223399    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223402    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223404    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223407    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223410    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223412    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223415    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223417    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223420    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223422    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223424    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223427    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223429    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223432    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223434    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223437    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223440    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223442    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223444    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223447    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:10.229544 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223449    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223452    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223454    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223457    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223460    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223462    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223464    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223467    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223469    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223473    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223476    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223479    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223481    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223484    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223486    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223489    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223492    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223495    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223497    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:10.230063 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223500    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223502    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223505    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223507    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223509    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223512    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223515    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223517    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223520    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223522    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223525    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223527    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223530    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223532    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223534    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223537    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223539    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223542    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223545    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223547    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:10.230528 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223550    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:10.223552    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.223557    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.223713    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.226067    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.227375    2578 server.go:1019] "Starting client certificate rotation"
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.227484    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.228081    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:10:10.231036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.229535    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:10:10.233247 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.233227    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:10:10.241905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.241883    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:10:10.245192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.245176    2578 log.go:25] "Validated CRI v1 image API"
Jul 29 01:10:10.247309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.247289    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:10:10.250219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.250194    2578 fs.go:135] Filesystem UUIDs: map[35588333-6145-4c8d-827b-68365f6c0663:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94f361e6-c29c-492b-8d88-44342c0ae56d:/dev/nvme0n1p3]
Jul 29 01:10:10.250296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.250217    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:10:10.255982 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.255851    2578 manager.go:216] Machine: {Timestamp:2026-07-29 01:10:10.253960455 +0000 UTC m=+0.283201359 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101752 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d30127793e2dea8b4c35c2ca01294 SystemUUID:ec2d3012-7793-e2de-a8b4-c35c2ca01294 BootID:c56d18ac-3181-4200-8ec1-825cd9761f97 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:c3:35:b4:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:c3:35:b4:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:a5:c6:13:a9:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:10:10.255982 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.255965    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:10:10.256134 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.256061    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:10:10.258436 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.258413    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:10:10.258671 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.258644    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:10:10.258835 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.258676    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:10:10.259459 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.259429    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:10:10.259489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.259462    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:10:10.259489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.259470    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:10:10.259947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.259936    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:10:10.261108 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.261095    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:10:10.264960 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.264944    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:10:10.265107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265097    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:10:10.265164 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265154    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:10:10.265193 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265172    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:10:10.265220 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265193    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:10:10.265220 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265216    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:10:10.265277 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265228    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:10:10.265721 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265707    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:10:10.265793 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.265730    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:10:10.267645 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.267629    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:10:10.269009 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.268994    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:10:10.269066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269026    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:10:10.269657 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269646    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269662    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269669    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269682    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269691    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269696    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269706    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:10:10.269709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269711    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:10:10.269882 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269718    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:10:10.269882 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269724    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:10:10.269882 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269738    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:10:10.269882 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.269743    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:10:10.270792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.270781    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:10:10.270792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.270792    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:10:10.274115 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.274101    2578 server.go:1268] "Started kubelet"
Jul 29 01:10:10.274281 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.274216    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:10:10.274335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.274282    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:10:10.274387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.274333    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:10:10.275110 ip-10-0-133-32 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:10:10.275756 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.275657    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:10:10.278881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.278818    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:10:10.280058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.280027    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:10:10.280058 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.280039    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:10:10.280247 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.280203    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:10:10.281208 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.281183    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:10:10.283641 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.282938    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-32.ec2.internal.18c69d70d75d0238  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-32.ec2.internal,UID:ip-10-0-133-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-32.ec2.internal,},FirstTimestamp:2026-07-29 01:10:10.274075192 +0000 UTC m=+0.303316097,LastTimestamp:2026-07-29 01:10:10.274075192 +0000 UTC m=+0.303316097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-32.ec2.internal,}"
Jul 29 01:10:10.285124 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285090    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:10:10.285124 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285097    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:10:10.285265 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.285188    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.285650 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285635    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:10:10.285650 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285638    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:10:10.285761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285660    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:10:10.285874 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285791    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:10:10.285874 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.285812    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:10:10.286349 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286333    2578 factory.go:153] Registering CRI-O factory
Jul 29 01:10:10.286349 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286350    2578 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:10:10.286487 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286403    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:10:10.286487 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286412    2578 factory.go:55] Registering systemd factory
Jul 29 01:10:10.286487 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286421    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:10:10.286487 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286441    2578 factory.go:103] Registering Raw factory
Jul 29 01:10:10.286487 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286453    2578 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:10:10.286968 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.286954    2578 manager.go:349] Starting recovery of all containers
Jul 29 01:10:10.289239 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.288972    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 01:10:10.289239 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.289102    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 01:10:10.298615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.298565    2578 manager.go:354] Recovery completed
Jul 29 01:10:10.299928 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.299882    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 01:10:10.302772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.302662    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plghm"
Jul 29 01:10:10.303274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.303262    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.305299 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305282    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.305350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305317    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.305350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305328    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.305876 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305856    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:10:10.305876 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305870    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.305876 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305876    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:10:10.305996 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.305892    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:10:10.306790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.306775    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.306877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.306807    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.306877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.306822    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.308067 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.307942    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-32.ec2.internal.18c69d70d939784c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-32.ec2.internal,UID:ip-10-0-133-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-32.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-32.ec2.internal,},FirstTimestamp:2026-07-29 01:10:10.305300556 +0000 UTC m=+0.334541463,LastTimestamp:2026-07-29 01:10:10.305300556 +0000 UTC m=+0.334541463,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-32.ec2.internal,}"
Jul 29 01:10:10.308141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.308085    2578 policy_none.go:49] "None policy: Start"
Jul 29 01:10:10.308141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.308099    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:10:10.308141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.308109    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:10:10.310179 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.310167    2578 policy_none.go:47] "Start"
Jul 29 01:10:10.310380 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.310363    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plghm"
Jul 29 01:10:10.354478 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.354296    2578 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:10:10.354608 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.354493    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:10:10.354608 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.354505    2578 server.go:87] "Starting device plugin registration server"
Jul 29 01:10:10.354852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.354839    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:10:10.354889 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.354857    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:10:10.354986 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.354960    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:10:10.355051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.355041    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:10:10.355051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.355049    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:10:10.355639 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.355616    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:10:10.355745 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.355676    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.455873 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.455801    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.458023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.456757    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.458023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.456790    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.458023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.456804    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.458023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.456834    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.462255 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.462225    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:10:10.463611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.463591    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:10:10.463746 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.463625    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:10:10.463746 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.463649    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:10:10.463746 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.463682    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:10:10.466317 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.466296    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:10.467106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.467085    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.467217 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.467109    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-32.ec2.internal\": node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.554517 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.554478    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.564501 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.564478    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"]
Jul 29 01:10:10.564623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.564606    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.565906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.565887    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.566015 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.565925    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.566015 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.565937    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.568385 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.568371    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.568520 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.568503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.568561 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.568547    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.569259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569241    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.569346 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569274    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.569346 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569285    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.569346 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569239    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.569346 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569344    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.569461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.569358    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.571755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.571735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.571872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.571765    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:10.572668 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.572649    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:10.572769 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.572689    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:10.572769 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.572704    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:10.586303 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.586273    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-32.ec2.internal\" not found" node="ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.587068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.587048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.587170 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.587073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.587170 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.587091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d59f0475dd3691eab2a3820645b1db6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-32.ec2.internal\" (UID: \"d59f0475dd3691eab2a3820645b1db6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.590954 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.590928    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-32.ec2.internal\" not found" node="ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.654611 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.654556    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.687278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.687411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.687411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d59f0475dd3691eab2a3820645b1db6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-32.ec2.internal\" (UID: \"d59f0475dd3691eab2a3820645b1db6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.687411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d59f0475dd3691eab2a3820645b1db6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-32.ec2.internal\" (UID: \"d59f0475dd3691eab2a3820645b1db6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.687411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.687411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.687404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d763c61bd921018d833f2ebca48cf9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal\" (UID: \"8d763c61bd921018d833f2ebca48cf9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.755404 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.755305    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.858191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.858143    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:10.889076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.889043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.894748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:10.894722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:10.958792 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:10.958729    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.062419 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.062312    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.164827 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.164767    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.206752 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.206730    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:11.226787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.226761    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:10:11.226944 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.226922    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:10:11.227005 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.226983    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:10:11.266076 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.266034    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.315026 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.314923    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:05:10 +0000 UTC" deadline="2028-04-26 08:48:46.659001772 +0000 UTC"
Jul 29 01:10:11.315026 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.314965    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15295h38m35.344040681s"
Jul 29 01:10:11.366225 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.366166    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.466928 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.466891    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.567762 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.567668    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.644426 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:11.644376    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59f0475dd3691eab2a3820645b1db6b.slice/crio-45431412574bf9c8160ab2da566a96142b45702e2bc6ec1704ea5ad546cc9604 WatchSource:0}: Error finding container 45431412574bf9c8160ab2da566a96142b45702e2bc6ec1704ea5ad546cc9604: Status 404 returned error can't find the container with id 45431412574bf9c8160ab2da566a96142b45702e2bc6ec1704ea5ad546cc9604
Jul 29 01:10:11.644685 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:11.644663    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d763c61bd921018d833f2ebca48cf9f.slice/crio-079e200876ec693454d92d2de7cf06d34ad51f795445371980599e7466e236ee WatchSource:0}: Error finding container 079e200876ec693454d92d2de7cf06d34ad51f795445371980599e7466e236ee: Status 404 returned error can't find the container with id 079e200876ec693454d92d2de7cf06d34ad51f795445371980599e7466e236ee
Jul 29 01:10:11.649140 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.649119    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:10:11.668824 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:11.668778    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-32.ec2.internal\" not found"
Jul 29 01:10:11.681852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.681828    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:11.765284 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.765257    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:11.786087 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.786029    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:11.799106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.799082    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:10:11.799932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.799918    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal"
Jul 29 01:10:11.807966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:11.807947    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:10:12.266897 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.266859    2578 apiserver.go:52] "Watching apiserver"
Jul 29 01:10:12.274309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.274278    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:10:12.275189 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.274735    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-nrv2q","openshift-multus/multus-additional-cni-plugins-pv4br","openshift-multus/multus-xkkzw","openshift-multus/network-metrics-daemon-hxcqh","openshift-network-diagnostics/network-check-target-4m74x","kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z","openshift-image-registry/node-ca-b5tgf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal","openshift-network-operator/iptables-alerter-dpl2f","openshift-ovn-kubernetes/ovnkube-node-9xfz5","kube-system/global-pull-secret-syncer-lg88h","kube-system/konnectivity-agent-b4nz7","openshift-cluster-node-tuning-operator/tuned-qdkd2"]
Jul 29 01:10:12.277488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.277466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.279593 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.279556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:10:12.279751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.279562    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.279900 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.279877    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.280206 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.280187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.280358 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.280340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hhnpr\""
Jul 29 01:10:12.282283 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.282264    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:10:12.282547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.282530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:10:12.282716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.282701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l5f5k\""
Jul 29 01:10:12.282888 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.282874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.284524 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.284502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.284645 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.284622    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:12.284944 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.284875    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:10:12.285175 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.285155    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:10:12.285175 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.285167    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.286595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.285390    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.286595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.285488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5vqsc\""
Jul 29 01:10:12.286595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.285834    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:10:12.286955 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.286936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:12.287030 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.287013    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:12.290519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.290495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.292445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.292424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.293685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.293177    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.293685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.293349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kq67x\""
Jul 29 01:10:12.293685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.293461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.294795 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.294778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vhg2c\""
Jul 29 01:10:12.294989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.294778    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.295066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.294991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.295066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.294828    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.295330 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.294871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:10:12.295524 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.295501    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:10:12.296652 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqnj\" (UniqueName: \"kubernetes.io/projected/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kube-api-access-wnqnj\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.296755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-cni-binary-copy\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-daemon-config\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.296755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52093707-d707-4572-8329-a568e2708dad-agent-certs\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-cnibin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-k8s-cni-cncf-io\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-bin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-multus\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-hostroot\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznsv\" (UniqueName: \"kubernetes.io/projected/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-kube-api-access-zznsv\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.296939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-os-release\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-kubelet\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.296994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-conf-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52093707-d707-4572-8329-a568e2708dad-konnectivity-ca\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-system-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-socket-dir-parent\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297222    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8mnnn\""
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvd4j\" (UniqueName: \"kubernetes.io/projected/dcbc5384-2732-4e32-afab-8cbd68b57c38-kube-api-access-fvd4j\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-netns\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297427    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-multus-certs\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-etc-kubernetes\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.297792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.298072 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.297866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.300236 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.299832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:10:12.307030 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.303899    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:10:12.307030 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.305065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bckl\""
Jul 29 01:10:12.307030 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.305454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.308671 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.308645    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.308823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.308784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b688l\""
Jul 29 01:10:12.308972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.308953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.310102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.309229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.310102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.309237    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:10:12.311545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.311239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.311545 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.311313    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.313451    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.313764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.313846    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.313954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.314045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m72nq\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.314129    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:10:12.314305 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.314205    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:10:12.317009 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.316985    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbwl6"
Jul 29 01:10:12.324492 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.324470    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbwl6"
Jul 29 01:10:12.386895 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.386866    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:10:12.398042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zznsv\" (UniqueName: \"kubernetes.io/projected/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-kube-api-access-zznsv\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.398232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-bin\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.398232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-conf\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.398232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7ff0041-fab4-41eb-ae78-6923ec920734-host-slash\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.398232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-os-release\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-lib-modules\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-conf-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.398427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-socket-dir-parent\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvd4j\" (UniqueName: \"kubernetes.io/projected/dcbc5384-2732-4e32-afab-8cbd68b57c38-kube-api-access-fvd4j\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-serviceca\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-conf-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-netns\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-var-lib-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-config\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-sys\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrkrs\" (UniqueName: \"kubernetes.io/projected/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-kube-api-access-hrkrs\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-os-release\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxjm\" (UniqueName: \"kubernetes.io/projected/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-kube-api-access-nsxjm\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-ovn\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.398809 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.398787    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-env-overrides\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovn-node-metrics-cert\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysconfig\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqnj\" (UniqueName: \"kubernetes.io/projected/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kube-api-access-wnqnj\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.398944    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:12.898920393 +0000 UTC m=+2.928161303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.398997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-cni-binary-copy\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-hosts-file\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-kubelet\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-slash\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-modprobe-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-tuned\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlpj\" (UniqueName: \"kubernetes.io/projected/ffca65e9-84a0-483e-8da9-df49d94e82c1-kube-api-access-2xlpj\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-cnibin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-k8s-cni-cncf-io\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-netns\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-socket-dir-parent\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-bin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-multus\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-hostroot\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxrm\" (UniqueName: \"kubernetes.io/projected/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-kube-api-access-2nxrm\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-tmp-dir\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-kubelet\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-systemd-units\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2sq\" (UniqueName: \"kubernetes.io/projected/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-kube-api-access-zp2sq\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-var-lib-kubelet\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-tmp\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-host\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.399918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cnibin\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-os-release\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6dj\" (UniqueName: \"kubernetes.io/projected/a7ff0041-fab4-41eb-ae78-6923ec920734-kube-api-access-8t6dj\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-system-cni-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52093707-d707-4572-8329-a568e2708dad-konnectivity-ca\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-system-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-script-lib\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-cni-binary-copy\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-host\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7ff0041-fab4-41eb-ae78-6923ec920734-iptables-alerter-script\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-bin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-cni-multus\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.399224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.400543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-cnibin\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-k8s-cni-cncf-io\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-hostroot\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-var-lib-kubelet\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-system-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-kubernetes\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-dbus\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.400999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-systemd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-node-log\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-kubelet-config\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-multus-certs\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-etc-kubernetes\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-log-socket\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-daemon-config\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-netd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52093707-d707-4572-8329-a568e2708dad-konnectivity-ca\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-systemd\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-run\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-netns\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-etc-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52093707-d707-4572-8329-a568e2708dad-agent-certs\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-cni-dir\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.401861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-etc-kubernetes\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.402347 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.401937    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:10:12.402347 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.402192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcbc5384-2732-4e32-afab-8cbd68b57c38-multus-daemon-config\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.402486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.402467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcbc5384-2732-4e32-afab-8cbd68b57c38-host-run-multus-certs\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.411073 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.410674    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:12.411073 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.410705    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:12.411073 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.410718    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:12.411073 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.410797    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:12.910769925 +0000 UTC m=+2.940010831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:12.411557 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.411490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqnj\" (UniqueName: \"kubernetes.io/projected/b9e6f28b-8ba3-4169-afbc-9bd9734e4da1-kube-api-access-wnqnj\") pod \"aws-ebs-csi-driver-node-k7h4z\" (UID: \"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.411557 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.411538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznsv\" (UniqueName: \"kubernetes.io/projected/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-kube-api-access-zznsv\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.411955 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.411933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52093707-d707-4572-8329-a568e2708dad-agent-certs\") pod \"konnectivity-agent-b4nz7\" (UID: \"52093707-d707-4572-8329-a568e2708dad\") " pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.412668 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.412617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvd4j\" (UniqueName: \"kubernetes.io/projected/dcbc5384-2732-4e32-afab-8cbd68b57c38-kube-api-access-fvd4j\") pod \"multus-xkkzw\" (UID: \"dcbc5384-2732-4e32-afab-8cbd68b57c38\") " pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.475687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.475540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal" event={"ID":"8d763c61bd921018d833f2ebca48cf9f","Type":"ContainerStarted","Data":"079e200876ec693454d92d2de7cf06d34ad51f795445371980599e7466e236ee"}
Jul 29 01:10:12.477507 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.477462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal" event={"ID":"d59f0475dd3691eab2a3820645b1db6b","Type":"ContainerStarted","Data":"45431412574bf9c8160ab2da566a96142b45702e2bc6ec1704ea5ad546cc9604"}
Jul 29 01:10:12.501980 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.501944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-dbus\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.501992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-systemd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-node-log\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-kubelet-config\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-log-socket\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-netd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-systemd\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-run\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-netns\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-etc-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-bin\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502321 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-conf\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7ff0041-fab4-41eb-ae78-6923ec920734-host-slash\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-lib-modules\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-serviceca\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-var-lib-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-config\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-sys\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrkrs\" (UniqueName: \"kubernetes.io/projected/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-kube-api-access-hrkrs\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxjm\" (UniqueName: \"kubernetes.io/projected/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-kube-api-access-nsxjm\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-ovn\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-env-overrides\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.502624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovn-node-metrics-cert\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysconfig\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-hosts-file\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-kubelet\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-slash\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-modprobe-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-tuned\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlpj\" (UniqueName: \"kubernetes.io/projected/ffca65e9-84a0-483e-8da9-df49d94e82c1-kube-api-access-2xlpj\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxrm\" (UniqueName: \"kubernetes.io/projected/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-kube-api-access-2nxrm\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-tmp-dir\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-systemd-units\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2sq\" (UniqueName: \"kubernetes.io/projected/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-kube-api-access-zp2sq\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-var-lib-kubelet\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-tmp\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.502992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-host\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.503202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cnibin\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-os-release\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6dj\" (UniqueName: \"kubernetes.io/projected/a7ff0041-fab4-41eb-ae78-6923ec920734-kube-api-access-8t6dj\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-system-cni-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-script-lib\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-host\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7ff0041-fab4-41eb-ae78-6923ec920734-iptables-alerter-script\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-kubernetes\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.503947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.503379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-kubernetes\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.504797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-dbus\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.504856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-systemd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.504897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-node-log\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.504940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-kubelet-config\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-log-socket\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-netd\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-systemd\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-run\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-run-netns\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-etc-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505434    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-cni-bin\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-modprobe-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysconfig\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-hosts-file\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.505899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-kubelet\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-host-slash\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7ff0041-fab4-41eb-ae78-6923ec920734-host-slash\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-lib-modules\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-host\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cnibin\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-os-release\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.505567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-conf\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-serviceca\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-system-cni-dir\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-var-lib-openvswitch\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-host\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.506748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.506805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-sys\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-script-lib\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-run-ovn\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovnkube-config\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-systemd-units\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-tmp-dir\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.507509    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:12.507545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-var-lib-kubelet\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.507933 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.507563    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:13.007550082 +0000 UTC m=+3.036790973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:12.507933 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.507933 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-sysctl-d\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.508087 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.507981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-env-overrides\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.508633 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.508609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7ff0041-fab4-41eb-ae78-6923ec920734-iptables-alerter-script\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.510975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.509856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.510975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.510143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-ovn-node-metrics-cert\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.510975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.510504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-etc-tuned\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.512491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.511397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffca65e9-84a0-483e-8da9-df49d94e82c1-tmp\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.514958 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.514930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrkrs\" (UniqueName: \"kubernetes.io/projected/26e9e02f-12de-4e5b-a6fc-ede1e0fd2022-kube-api-access-hrkrs\") pod \"node-resolver-nrv2q\" (UID: \"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022\") " pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.517672 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.517525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6dj\" (UniqueName: \"kubernetes.io/projected/a7ff0041-fab4-41eb-ae78-6923ec920734-kube-api-access-8t6dj\") pod \"iptables-alerter-dpl2f\" (UID: \"a7ff0041-fab4-41eb-ae78-6923ec920734\") " pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.519322 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.518879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlpj\" (UniqueName: \"kubernetes.io/projected/ffca65e9-84a0-483e-8da9-df49d94e82c1-kube-api-access-2xlpj\") pod \"tuned-qdkd2\" (UID: \"ffca65e9-84a0-483e-8da9-df49d94e82c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.519322 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.519276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2sq\" (UniqueName: \"kubernetes.io/projected/4aa2464e-96a6-4fa5-bdf5-a6b359c35546-kube-api-access-zp2sq\") pod \"ovnkube-node-9xfz5\" (UID: \"4aa2464e-96a6-4fa5-bdf5-a6b359c35546\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.520363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.520176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxrm\" (UniqueName: \"kubernetes.io/projected/deaa41ae-5ccc-4706-8f61-4c6f2f97cd92-kube-api-access-2nxrm\") pod \"node-ca-b5tgf\" (UID: \"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92\") " pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.521276 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.521243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxjm\" (UniqueName: \"kubernetes.io/projected/accdd1bb-dce0-46b4-8b23-4be5ceda0c65-kube-api-access-nsxjm\") pod \"multus-additional-cni-plugins-pv4br\" (UID: \"accdd1bb-dce0-46b4-8b23-4be5ceda0c65\") " pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.535393 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.535360    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:12.595050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.595013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z"
Jul 29 01:10:12.609535 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.609505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:12.618741 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.618703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkkzw"
Jul 29 01:10:12.626757 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.626723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdkd2"
Jul 29 01:10:12.635861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.635827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5tgf"
Jul 29 01:10:12.645136 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.645103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nrv2q"
Jul 29 01:10:12.652203 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.652171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pv4br"
Jul 29 01:10:12.662231 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.662199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpl2f"
Jul 29 01:10:12.668283 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.668253    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:12.906357 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.906320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:12.906537 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.906503    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:12.906617 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:12.906605    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:13.906566774 +0000 UTC m=+3.935807682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:12.963250 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:12.963215    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:13.007528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.007501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:13.007707 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.007673    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:13.007707 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.007694    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:13.007707 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.007705    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:13.007858 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.007763    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:14.007744918 +0000 UTC m=+4.036985810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:13.108665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.108628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:13.108858 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.108779    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:13.108858 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.108856    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:14.108834881 +0000 UTC m=+4.138075774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:13.328555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.328470    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:05:12 +0000 UTC" deadline="2028-02-24 01:04:56.241065116 +0000 UTC"
Jul 29 01:10:13.328555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.328505    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13799h54m42.912562972s"
Jul 29 01:10:13.464420 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.464386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:13.464603 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.464521    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:13.543113 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.543083    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52093707_d707_4572_8329_a568e2708dad.slice/crio-a03f66ad241b434a9e8197f8188bb858f154752905d67352f97fabb13fb34fe4 WatchSource:0}: Error finding container a03f66ad241b434a9e8197f8188bb858f154752905d67352f97fabb13fb34fe4: Status 404 returned error can't find the container with id a03f66ad241b434a9e8197f8188bb858f154752905d67352f97fabb13fb34fe4
Jul 29 01:10:13.546901 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.546876    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa2464e_96a6_4fa5_bdf5_a6b359c35546.slice/crio-aeea37bdb591075f96d30bc2d6ba6fe397a829adb3fa551dd66bcfe289334016 WatchSource:0}: Error finding container aeea37bdb591075f96d30bc2d6ba6fe397a829adb3fa551dd66bcfe289334016: Status 404 returned error can't find the container with id aeea37bdb591075f96d30bc2d6ba6fe397a829adb3fa551dd66bcfe289334016
Jul 29 01:10:13.548083 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.547698    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e9e02f_12de_4e5b_a6fc_ede1e0fd2022.slice/crio-deb274c31d31285908975cdab02949bfd334dcddc5a5dfb17828b7ea93aa1192 WatchSource:0}: Error finding container deb274c31d31285908975cdab02949bfd334dcddc5a5dfb17828b7ea93aa1192: Status 404 returned error can't find the container with id deb274c31d31285908975cdab02949bfd334dcddc5a5dfb17828b7ea93aa1192
Jul 29 01:10:13.555055 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.554974    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e6f28b_8ba3_4169_afbc_9bd9734e4da1.slice/crio-c4435f7872195b7a5f9ac22200d7efbda4f5b248e85c2b32687ac095a317021d WatchSource:0}: Error finding container c4435f7872195b7a5f9ac22200d7efbda4f5b248e85c2b32687ac095a317021d: Status 404 returned error can't find the container with id c4435f7872195b7a5f9ac22200d7efbda4f5b248e85c2b32687ac095a317021d
Jul 29 01:10:13.556209 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.556179    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ff0041_fab4_41eb_ae78_6923ec920734.slice/crio-1fa12a053d0945546dcc7a46a2d47293914e91792738f46f0d0f1206bbb961a9 WatchSource:0}: Error finding container 1fa12a053d0945546dcc7a46a2d47293914e91792738f46f0d0f1206bbb961a9: Status 404 returned error can't find the container with id 1fa12a053d0945546dcc7a46a2d47293914e91792738f46f0d0f1206bbb961a9
Jul 29 01:10:13.557236 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.557218    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccdd1bb_dce0_46b4_8b23_4be5ceda0c65.slice/crio-3008099e73521e91b74b9666f69eb989e0cc31c4a8f585a7f1dafe9c430d06ae WatchSource:0}: Error finding container 3008099e73521e91b74b9666f69eb989e0cc31c4a8f585a7f1dafe9c430d06ae: Status 404 returned error can't find the container with id 3008099e73521e91b74b9666f69eb989e0cc31c4a8f585a7f1dafe9c430d06ae
Jul 29 01:10:13.557694 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.557675    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffca65e9_84a0_483e_8da9_df49d94e82c1.slice/crio-beec530efebdc41dd4a54bf68cd252478676a1e2f3365036f60dce93f83332b2 WatchSource:0}: Error finding container beec530efebdc41dd4a54bf68cd252478676a1e2f3365036f60dce93f83332b2: Status 404 returned error can't find the container with id beec530efebdc41dd4a54bf68cd252478676a1e2f3365036f60dce93f83332b2
Jul 29 01:10:13.579207 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:13.579175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbc5384_2732_4e32_afab_8cbd68b57c38.slice/crio-28156aa8738bfa043b3c4925d476820e278d28c7c01f9ebc029d088c861b84a2 WatchSource:0}: Error finding container 28156aa8738bfa043b3c4925d476820e278d28c7c01f9ebc029d088c861b84a2: Status 404 returned error can't find the container with id 28156aa8738bfa043b3c4925d476820e278d28c7c01f9ebc029d088c861b84a2
Jul 29 01:10:13.915932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:13.915645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:13.915932 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.915825    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:13.915932 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:13.915907    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:15.915886899 +0000 UTC m=+5.945127804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:14.017174 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.016539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:14.017174 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.016719    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:14.017174 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.016742    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:14.017174 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.016754    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:14.017174 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.016821    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:16.016802831 +0000 UTC m=+6.046043736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:14.118632 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.118155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:14.118632 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.118319    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:14.118632 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.118384    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:16.118365334 +0000 UTC m=+6.147606230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:14.329702 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.329567    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:05:12 +0000 UTC" deadline="2028-04-28 08:42:17.468153188 +0000 UTC"
Jul 29 01:10:14.329702 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.329647    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15343h32m3.138510581s"
Jul 29 01:10:14.467670 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.466940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:14.467670 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.467079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:14.467670 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.467492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:14.467670 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:14.467607    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:14.494211 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.492872    2578 generic.go:356] "Generic (PLEG): container finished" podID="8d763c61bd921018d833f2ebca48cf9f" containerID="ca5d2a5ffa993e1781527d548d2c3e850dea035bd58a2bde8b00004e026943a1" exitCode=0
Jul 29 01:10:14.494211 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.492970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal" event={"ID":"8d763c61bd921018d833f2ebca48cf9f","Type":"ContainerDied","Data":"ca5d2a5ffa993e1781527d548d2c3e850dea035bd58a2bde8b00004e026943a1"}
Jul 29 01:10:14.502947 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.502911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal" event={"ID":"d59f0475dd3691eab2a3820645b1db6b","Type":"ContainerStarted","Data":"ad228d1ec9f49b16e4d8ec1ad693b2f5a83f47848460a86515e96232a225192c"}
Jul 29 01:10:14.511193 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.511158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerStarted","Data":"3008099e73521e91b74b9666f69eb989e0cc31c4a8f585a7f1dafe9c430d06ae"}
Jul 29 01:10:14.518983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.518944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpl2f" event={"ID":"a7ff0041-fab4-41eb-ae78-6923ec920734","Type":"ContainerStarted","Data":"1fa12a053d0945546dcc7a46a2d47293914e91792738f46f0d0f1206bbb961a9"}
Jul 29 01:10:14.522174 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.522140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z" event={"ID":"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1","Type":"ContainerStarted","Data":"c4435f7872195b7a5f9ac22200d7efbda4f5b248e85c2b32687ac095a317021d"}
Jul 29 01:10:14.524598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.524507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nrv2q" event={"ID":"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022","Type":"ContainerStarted","Data":"deb274c31d31285908975cdab02949bfd334dcddc5a5dfb17828b7ea93aa1192"}
Jul 29 01:10:14.529797 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.529757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"aeea37bdb591075f96d30bc2d6ba6fe397a829adb3fa551dd66bcfe289334016"}
Jul 29 01:10:14.538130 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.538088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5tgf" event={"ID":"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92","Type":"ContainerStarted","Data":"d0102093d46e7af90d0715588655bb19395b9f3b8e0e6c8023a7c70678fe45c5"}
Jul 29 01:10:14.554085 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.554032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkkzw" event={"ID":"dcbc5384-2732-4e32-afab-8cbd68b57c38","Type":"ContainerStarted","Data":"28156aa8738bfa043b3c4925d476820e278d28c7c01f9ebc029d088c861b84a2"}
Jul 29 01:10:14.566448 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.566410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdkd2" event={"ID":"ffca65e9-84a0-483e-8da9-df49d94e82c1","Type":"ContainerStarted","Data":"beec530efebdc41dd4a54bf68cd252478676a1e2f3365036f60dce93f83332b2"}
Jul 29 01:10:14.586219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:14.586124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b4nz7" event={"ID":"52093707-d707-4572-8329-a568e2708dad","Type":"ContainerStarted","Data":"a03f66ad241b434a9e8197f8188bb858f154752905d67352f97fabb13fb34fe4"}
Jul 29 01:10:15.464622 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:15.464570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:15.465186 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:15.464743    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:15.606884 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:15.606821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal" event={"ID":"8d763c61bd921018d833f2ebca48cf9f","Type":"ContainerStarted","Data":"0f0c2a887836d9e73ad9cd4c74d5cab95aaa1f69f97478d5e5f875cc63ee1fae"}
Jul 29 01:10:15.621437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:15.620391    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-32.ec2.internal" podStartSLOduration=4.620368003 podStartE2EDuration="4.620368003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:14.531721424 +0000 UTC m=+4.560962341" watchObservedRunningTime="2026-07-29 01:10:15.620368003 +0000 UTC m=+5.649608918"
Jul 29 01:10:15.621437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:15.620704    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-32.ec2.internal" podStartSLOduration=4.620689464 podStartE2EDuration="4.620689464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:15.619845692 +0000 UTC m=+5.649086608" watchObservedRunningTime="2026-07-29 01:10:15.620689464 +0000 UTC m=+5.649930381"
Jul 29 01:10:15.934065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:15.933974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:15.934243 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:15.934224    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:15.934306 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:15.934291    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:19.934272358 +0000 UTC m=+9.963513264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:16.035800 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:16.034920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:16.035800 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.035134    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:16.035800 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.035153    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:16.035800 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.035165    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:16.035800 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.035225    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:20.035206846 +0000 UTC m=+10.064447739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:16.136760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:16.136259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:16.136760 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.136431    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:16.136760 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.136482    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:20.136468757 +0000 UTC m=+10.165709649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:16.469908 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:16.469878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:16.470387 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.469998    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:16.470387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:16.470085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:16.470387 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:16.470150    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:17.464785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:17.464224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:17.464785 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:17.464426    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:18.464802 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:18.464719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:18.465254 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:18.464845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:18.465254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:18.464731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:18.465367 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:18.465351    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:19.464056 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:19.464017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:19.464223 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:19.464185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:19.971706 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:19.971668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:19.972167 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:19.971827    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:19.972167 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:19.971899    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:27.971879707 +0000 UTC m=+18.001120619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:20.073127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:20.073086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:20.073319 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.073290    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:20.073319 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.073313    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:20.073402 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.073326    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:20.073402 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.073385    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:28.073367714 +0000 UTC m=+18.102608609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:20.174550 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:20.174431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:20.174740 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.174602    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:20.174740 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.174681    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:28.174661034 +0000 UTC m=+18.203901926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:20.465405 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:20.465320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:20.465567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:20.465320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:20.465567 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.465481    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:20.465567 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:20.465501    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:21.464700 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:21.464662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:21.465147 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:21.464806    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:22.465251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:22.464616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:22.465251 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:22.464750    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:22.465251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:22.465121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:22.465251 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:22.465187    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:23.464401 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:23.464358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:23.464587 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:23.464484    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:24.464621 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:24.464566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:24.465008 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:24.464701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:24.465008 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:24.464706    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:24.465008 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:24.464785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:25.464319 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:25.464283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:25.464503 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:25.464423    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:26.464349 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:26.464309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:26.464825 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:26.464445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:26.464825 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:26.464507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:26.464825 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:26.464653    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:27.464553 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:27.464515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:27.465081 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:27.464662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:28.035550 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:28.035502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:28.035777 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.035669    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:28.035777 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.035735    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:10:44.035716801 +0000 UTC m=+34.064957695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:28.136347 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:28.136307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:28.136536 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.136452    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:28.136536 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.136474    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:28.136536 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.136483    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:28.136739 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.136541    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:44.136522523 +0000 UTC m=+34.165763417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:28.237010 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:28.236953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:28.237191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.237110    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:28.237191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.237177    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:10:44.237160286 +0000 UTC m=+34.266401183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:28.464645 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:28.464544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:28.464645 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:28.464607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:28.465145 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.464724    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:28.465145 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:28.464848    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:29.464185 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:29.464150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:29.464351 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:29.464279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:30.465437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:30.465402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:30.465936 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:30.465531    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:30.465936 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:30.465627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:30.465936 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:30.465764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:31.464164 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:31.464126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:31.464391 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:31.464273    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:32.464484 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:32.464443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:32.464924 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:32.464603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:32.464924 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:32.464634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:32.464924 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:32.464738    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:33.464704 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.464328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:33.465559 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:33.464821    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:33.651280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.651239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nrv2q" event={"ID":"26e9e02f-12de-4e5b-a6fc-ede1e0fd2022","Type":"ContainerStarted","Data":"786ffffff26b5cff8a1ab75b37b80934bde3c9f0ba815018d37b479eb4c36a8f"}
Jul 29 01:10:33.655988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.655959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"0ebbb8b80338a6ddaaf53823c7fd6a9c73ce6c707060997c881764ae0f614a0a"}
Jul 29 01:10:33.656169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.656041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"a1037036af2efbd5889b962fa49342a0f6741d4d15f500fe99fb0aa3cd7dd714"}
Jul 29 01:10:33.656169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.656084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"2d83f277f485c4cf430dcb81e93672405903cec341d5f218fab28a3c67d88f5f"}
Jul 29 01:10:33.656169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.656126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"37586573b08e5bb417c089ce229687f040697c177ebb71a9bdbb1fecb923f532"}
Jul 29 01:10:33.656169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.656168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"5bf8aef1dc5bb5ea65c5f2b30711969a1feb19eacd2d72cd3cdb758d10da2a66"}
Jul 29 01:10:33.656365 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.656215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"ecebd28a43d9588e7e2bc69ef85ef8f4dec4791d93da668fb571788a748f5eb2"}
Jul 29 01:10:33.657280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.657250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5tgf" event={"ID":"deaa41ae-5ccc-4706-8f61-4c6f2f97cd92","Type":"ContainerStarted","Data":"b5c11d249355af94b35032d42f0af25b9ce7c2085b2ab87b1ffca56fa1c33554"}
Jul 29 01:10:33.658562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.658538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkkzw" event={"ID":"dcbc5384-2732-4e32-afab-8cbd68b57c38","Type":"ContainerStarted","Data":"5c172dfccd49e262dc01587f99963262a6b00a448ff3870b2a59cdb2b923835c"}
Jul 29 01:10:33.659900 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.659874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdkd2" event={"ID":"ffca65e9-84a0-483e-8da9-df49d94e82c1","Type":"ContainerStarted","Data":"09cc282475f3471356145c48f9871dde3a0e2e76b6a83f5abcbc1b854cb30caa"}
Jul 29 01:10:33.661255 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.661220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b4nz7" event={"ID":"52093707-d707-4572-8329-a568e2708dad","Type":"ContainerStarted","Data":"fb26c483340a12a16f39ff3567dfb1964f6075e9badc6bd13787deb1c7cb279e"}
Jul 29 01:10:33.662660 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.662635    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="97371933e0238e14ca6ca93e07df1fd637b30fa9b91c172b43600df9b9e53541" exitCode=0
Jul 29 01:10:33.662747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.662710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"97371933e0238e14ca6ca93e07df1fd637b30fa9b91c172b43600df9b9e53541"}
Jul 29 01:10:33.663932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.663913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z" event={"ID":"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1","Type":"ContainerStarted","Data":"0ba56b0a8bfe099e904ccec6276a0d2b71a3c2fcc6cfea317d0bd01a6d6cbaf7"}
Jul 29 01:10:33.666308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.666266    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nrv2q" podStartSLOduration=4.634195682 podStartE2EDuration="23.66625425s" totalImagesPullingTime="19.032058568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:33.665772792 +0000 UTC m=+23.695013707" watchObservedRunningTime="2026-07-29 01:10:33.66625425 +0000 UTC m=+23.695495163"
Jul 29 01:10:33.680447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.680399    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b4nz7" podStartSLOduration=4.638750595 podStartE2EDuration="23.680383399s" totalImagesPullingTime="19.041632804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:33.680106878 +0000 UTC m=+23.709347793" watchObservedRunningTime="2026-07-29 01:10:33.680383399 +0000 UTC m=+23.709624312"
Jul 29 01:10:33.696248 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.696194    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xkkzw" podStartSLOduration=4.683875595 podStartE2EDuration="23.696178189s" totalImagesPullingTime="19.012302594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:33.695554018 +0000 UTC m=+23.724794934" watchObservedRunningTime="2026-07-29 01:10:33.696178189 +0000 UTC m=+23.725419130"
Jul 29 01:10:33.711658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.711613    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qdkd2" podStartSLOduration=4.696878802 podStartE2EDuration="23.711597789s" totalImagesPullingTime="19.014718987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:33.711348417 +0000 UTC m=+23.740589332" watchObservedRunningTime="2026-07-29 01:10:33.711597789 +0000 UTC m=+23.740838711"
Jul 29 01:10:33.760630 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.760558    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5tgf" podStartSLOduration=12.693797512 podStartE2EDuration="23.76052096s" totalImagesPullingTime="11.066723448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:33.726014285 +0000 UTC m=+23.755255199" watchObservedRunningTime="2026-07-29 01:10:33.76052096 +0000 UTC m=+23.789761917"
Jul 29 01:10:33.848028 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:33.847999    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:10:34.367599 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.367423    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:10:33.848020035Z","UUID":"5f1250c8-c42a-4cf7-a02c-df232df82c59","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:10:34.369062 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.369038    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:10:34.369234 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.369081    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:10:34.465746 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.465708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:34.466165 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:34.465852    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:34.466165 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.465915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:34.466165 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:34.466021    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:34.668437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.668341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpl2f" event={"ID":"a7ff0041-fab4-41eb-ae78-6923ec920734","Type":"ContainerStarted","Data":"17f3490b446f2bca7f2b8e6d06f787e41760c3fba6be526074fb6f5ba3815d68"}
Jul 29 01:10:34.670530 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.670492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z" event={"ID":"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1","Type":"ContainerStarted","Data":"b7ab1dcc0ae89a45e45e756298acfa7ee92ceaf344df1667e33af0fc4f5b50de"}
Jul 29 01:10:34.682464 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:34.682393    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpl2f" podStartSLOduration=5.67235458 podStartE2EDuration="24.682372531s" totalImagesPullingTime="19.010017951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:34.682190624 +0000 UTC m=+24.711431552" watchObservedRunningTime="2026-07-29 01:10:34.682372531 +0000 UTC m=+24.711613446"
Jul 29 01:10:35.464610 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:35.464568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:35.464749 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:35.464702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:35.675813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:35.675702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z" event={"ID":"b9e6f28b-8ba3-4169-afbc-9bd9734e4da1","Type":"ContainerStarted","Data":"93eaa60eb4d1937d86c4220cc886ef436425805cd0fcb669c045d2a5d939c0e5"}
Jul 29 01:10:35.680007 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:35.679977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"40c015916326e61e368ce4bd581e0da082d477388ee50e50b55c526b90bfe854"}
Jul 29 01:10:35.695264 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:35.695209    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h4z" podStartSLOduration=4.518473086 podStartE2EDuration="25.695192959s" totalImagesPullingTime="21.176719873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:35.695099502 +0000 UTC m=+25.724340416" watchObservedRunningTime="2026-07-29 01:10:35.695192959 +0000 UTC m=+25.724433874"
Jul 29 01:10:36.464526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:36.464489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:36.464731 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:36.464489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:36.464731 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:36.464655    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:36.464731 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:36.464709    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:37.361173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:37.361137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:37.361929 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:37.361908    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:37.464559 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:37.464519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:37.464754 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:37.464696    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:37.684881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:37.684800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:37.685503 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:37.685480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b4nz7"
Jul 29 01:10:38.464974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.464783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:38.465686 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.464838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:38.465686 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:38.465047    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:38.465686 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:38.465121    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:38.687972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.687938    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="8b99744999cb1b1a4ec646fa8d13c98d7ba011149a137f25aa96e53ff9772b6b" exitCode=0
Jul 29 01:10:38.688142 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.688028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"8b99744999cb1b1a4ec646fa8d13c98d7ba011149a137f25aa96e53ff9772b6b"}
Jul 29 01:10:38.691813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.691770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" event={"ID":"4aa2464e-96a6-4fa5-bdf5-a6b359c35546","Type":"ContainerStarted","Data":"b50cb22cda25e56b6c8f6e6fb61de9d80154e0e2dbceb6719d95184cc2d8c83f"}
Jul 29 01:10:38.691960 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.691937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:38.733922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:38.733865    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5" podStartSLOduration=9.631868777 podStartE2EDuration="28.733849758s" totalImagesPullingTime="19.101980981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:38.733256057 +0000 UTC m=+28.762496971" watchObservedRunningTime="2026-07-29 01:10:38.733849758 +0000 UTC m=+28.763090672"
Jul 29 01:10:39.465090 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.464834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:39.465491 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:39.465210    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:39.694648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.694621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:39.694903 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.694700    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:39.711825 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.711796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:39.711974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.711942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:10:39.857410 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.857382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hxcqh"]
Jul 29 01:10:39.857615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.857566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:39.857790 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:39.857734    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:39.859795 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.859753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg88h"]
Jul 29 01:10:39.859928 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.859874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:39.860031 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:39.859973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:39.862950 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.862925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4m74x"]
Jul 29 01:10:39.863047 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:39.863034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:39.863142 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:39.863126    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:40.698032 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:40.697999    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="9190abbea0c5612ddeba3cd1d34ffe98a2b3d6c485af4130c267a5fa4c44f45c" exitCode=0
Jul 29 01:10:40.698480 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:40.698092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"9190abbea0c5612ddeba3cd1d34ffe98a2b3d6c485af4130c267a5fa4c44f45c"}
Jul 29 01:10:41.464724 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:41.464688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:41.464910 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:41.464789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:41.464910 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:41.464795    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:41.464910 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:41.464824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:41.465094 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:41.464919    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:41.465094 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:41.465018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:42.705360 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:42.705328    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="4bae1cbca25722d8e867ef033898e7731f9865ed8b9d22d3d1e1b6d338dbb182" exitCode=0
Jul 29 01:10:42.705792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:42.705371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"4bae1cbca25722d8e867ef033898e7731f9865ed8b9d22d3d1e1b6d338dbb182"}
Jul 29 01:10:43.464105 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:43.464066    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:43.464326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:43.464120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:43.464326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:43.464196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:43.464326 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:43.464196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4m74x" podUID="c0844f6a-b04a-4167-8a6e-b4be9e6263a6"
Jul 29 01:10:43.464326 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:43.464314    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg88h" podUID="6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc"
Jul 29 01:10:43.464548 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:43.464394    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:10:44.060394 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:44.060187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:44.060853 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.060345    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:44.060853 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.060481    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:11:16.060459822 +0000 UTC m=+66.089700716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:44.161508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:44.161469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:44.161686 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.161637    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:44.161686 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.161655    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:44.161686 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.161667    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jw5p6 for pod openshift-network-diagnostics/network-check-target-4m74x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:44.161834 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.161732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6 podName:c0844f6a-b04a-4167-8a6e-b4be9e6263a6 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:16.161714157 +0000 UTC m=+66.190955053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw5p6" (UniqueName: "kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6") pod "network-check-target-4m74x" (UID: "c0844f6a-b04a-4167-8a6e-b4be9e6263a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:44.262182 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:44.262147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:44.262365 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.262298    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:44.262365 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:44.262353    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret podName:6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc nodeName:}" failed. No retries permitted until 2026-07-29 01:11:16.262339956 +0000 UTC m=+66.291580847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret") pod "global-pull-secret-syncer-lg88h" (UID: "6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:45.366274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.366199    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-32.ec2.internal" event="NodeReady"
Jul 29 01:10:45.366688 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.366382    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:10:45.400779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.400751    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:10:45.404818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.404789    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"]
Jul 29 01:10:45.404982 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.404926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.407072 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.407050    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 01:10:45.407254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.407230    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 01:10:45.407389 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.407326    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 01:10:45.407450 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.407409    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cdts5\""
Jul 29 01:10:45.408465 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.408444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.410897 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.410872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mpdbl\""
Jul 29 01:10:45.411095 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.411080    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 01:10:45.411188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.411129    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 01:10:45.413061 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.413036    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9ptcc"]
Jul 29 01:10:45.414853 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.414835    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 01:10:45.416533 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.416514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.418597 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.418554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:10:45.418692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.418611    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:10:45.419014 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.418998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:10:45.419080 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.419063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ccxn7\""
Jul 29 01:10:45.419281 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.419265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:10:45.419726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.419708    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"]
Jul 29 01:10:45.420285 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.420239    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5j2zt"]
Jul 29 01:10:45.424004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.423981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.426334 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.426286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:10:45.426439 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.426348    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:10:45.426439 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.426376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rpdf\""
Jul 29 01:10:45.428751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.428726    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ptcc"]
Jul 29 01:10:45.432064 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.432038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5j2zt"]
Jul 29 01:10:45.464138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.464106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:10:45.464318 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.464106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:10:45.464425 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.464106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:10:45.466394 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.466373    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:45.466879 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.466858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:45.466997 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.466907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d72dr\""
Jul 29 01:10:45.467195 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.467179    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:45.467381 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.467363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:45.467501 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.467484    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llbnf\""
Jul 29 01:10:45.571942 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.571899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.571942 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.571934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.571960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.571984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bc4543b-3ba8-4273-95e8-a258faa03958-cert\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2jd\" (UniqueName: \"kubernetes.io/projected/2bc4543b-3ba8-4273-95e8-a258faa03958-kube-api-access-mk2jd\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.572192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7ldg\" (UniqueName: \"kubernetes.io/projected/a6cb163e-59ae-40c0-ab81-952320ea89b9-kube-api-access-v7ldg\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jjmj\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cb163e-59ae-40c0-ab81-952320ea89b9-config-volume\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cb163e-59ae-40c0-ab81-952320ea89b9-tmp-dir\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.572488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.572475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.573239 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.573201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:45.658501 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.658392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:45.673313 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.673313 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7ldg\" (UniqueName: \"kubernetes.io/projected/a6cb163e-59ae-40c0-ab81-952320ea89b9-kube-api-access-v7ldg\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.673572 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.673468    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:45.673572 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.673572 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.673572 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.673556    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:46.173534034 +0000 UTC m=+36.202774943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jjmj\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cb163e-59ae-40c0-ab81-952320ea89b9-config-volume\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cb163e-59ae-40c0-ab81-952320ea89b9-tmp-dir\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.673801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bc4543b-3ba8-4273-95e8-a258faa03958-cert\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.673882    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.673896    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2jd\" (UniqueName: \"kubernetes.io/projected/2bc4543b-3ba8-4273-95e8-a258faa03958-kube-api-access-mk2jd\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.673950    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:46.173938382 +0000 UTC m=+36.203179274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:10:45.674117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.673978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cb163e-59ae-40c0-ab81-952320ea89b9-tmp-dir\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.674541 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.674317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cb163e-59ae-40c0-ab81-952320ea89b9-config-volume\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.674541 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.674370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.674541 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.674438    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:45.674541 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:45.674468    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:46.174458328 +0000 UTC m=+36.203699220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:45.674761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.674675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:45.674761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.674680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.674869 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.674851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.678767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.678730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.678767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.678741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.678959 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.678806    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bc4543b-3ba8-4273-95e8-a258faa03958-cert\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.682599 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.682552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.682741 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.682722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2jd\" (UniqueName: \"kubernetes.io/projected/2bc4543b-3ba8-4273-95e8-a258faa03958-kube-api-access-mk2jd\") pod \"ingress-canary-9ptcc\" (UID: \"2bc4543b-3ba8-4273-95e8-a258faa03958\") " pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:45.682929 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.682903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jjmj\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:45.683078 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.683046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7ldg\" (UniqueName: \"kubernetes.io/projected/a6cb163e-59ae-40c0-ab81-952320ea89b9-kube-api-access-v7ldg\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:45.737977 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:45.737939    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ptcc"
Jul 29 01:10:46.179561 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:46.179516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:46.179764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:46.179646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:46.179764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:46.179682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:46.179764 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179710    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179784    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:47.179765838 +0000 UTC m=+37.209006732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179795    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179799    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179811    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179864    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:47.179846027 +0000 UTC m=+37.209086936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:46.179943 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:46.179887    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:47.179875323 +0000 UTC m=+37.209116215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:10:46.920656 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:46.920489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ptcc"]
Jul 29 01:10:46.923955 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:10:46.923926    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc4543b_3ba8_4273_95e8_a258faa03958.slice/crio-6b416ed9f08199022e5c3264727a85b562c60e81b888f6698b784a7ddfff42fd WatchSource:0}: Error finding container 6b416ed9f08199022e5c3264727a85b562c60e81b888f6698b784a7ddfff42fd: Status 404 returned error can't find the container with id 6b416ed9f08199022e5c3264727a85b562c60e81b888f6698b784a7ddfff42fd
Jul 29 01:10:47.188867 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.188831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:47.189029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.188880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:47.189029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.188902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:47.189029 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.188995    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:47.189029 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.188993    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:47.189149 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.189064    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:49.18904932 +0000 UTC m=+39.218290212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:47.189149 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.188998    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:47.189149 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.189103    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:49.18909421 +0000 UTC m=+39.218335101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:47.189149 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.189006    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:10:47.189149 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:47.189138    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:49.189132042 +0000 UTC m=+39.218372935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:10:47.228905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.228871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:47.332890 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.332796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:47.718813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.718727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ptcc" event={"ID":"2bc4543b-3ba8-4273-95e8-a258faa03958","Type":"ContainerStarted","Data":"6b416ed9f08199022e5c3264727a85b562c60e81b888f6698b784a7ddfff42fd"}
Jul 29 01:10:47.721755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.721714    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="912f479ef953af351ccfc9933db497d6a8df12135ffc865315d25731ad9ba8f4" exitCode=0
Jul 29 01:10:47.721912 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.721766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"912f479ef953af351ccfc9933db497d6a8df12135ffc865315d25731ad9ba8f4"}
Jul 29 01:10:47.855716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.855678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:47.955967 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:47.955932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:48.274788 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:48.274753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:48.374872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:48.374835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:48.730300 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:48.730209    2578 generic.go:356] "Generic (PLEG): container finished" podID="accdd1bb-dce0-46b4-8b23-4be5ceda0c65" containerID="bb99aafd7845cf851c2723a62013432a3d2ed65bf5fcbb8219ad192d37f817cd" exitCode=0
Jul 29 01:10:48.730472 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:48.730295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerDied","Data":"bb99aafd7845cf851c2723a62013432a3d2ed65bf5fcbb8219ad192d37f817cd"}
Jul 29 01:10:49.205732 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.205691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.205759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.205796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205840    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205897    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205901    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205911    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205919    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:53.205903416 +0000 UTC m=+43.235144326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:53.205946674 +0000 UTC m=+43.235187572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:49.206191 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:49.205990    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:53.205980126 +0000 UTC m=+43.235221022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:10:49.735974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.735941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv4br" event={"ID":"accdd1bb-dce0-46b4-8b23-4be5ceda0c65","Type":"ContainerStarted","Data":"f2ee1955c2a57cb47a829b43f71ccd57cc5b6082783a6f33d302171c1196bbb8"}
Jul 29 01:10:49.758826 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.758771    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pv4br" podStartSLOduration=10.174759223 podStartE2EDuration="39.758754904s" totalImagesPullingTime="29.583995681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:49.757677789 +0000 UTC m=+39.786918703" watchObservedRunningTime="2026-07-29 01:10:49.758754904 +0000 UTC m=+39.787995817"
Jul 29 01:10:49.786961 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.786924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:49.883299 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.883248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:49.983663 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:49.983631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:50.038395 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:50.038362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:50.739852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:50.739820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ptcc" event={"ID":"2bc4543b-3ba8-4273-95e8-a258faa03958","Type":"ContainerStarted","Data":"81ba02198cc50fef5ae401f69099e5a890234bbf935d5548fdf6282ecc46ff5d"}
Jul 29 01:10:50.756380 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:50.756324    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9ptcc" podStartSLOduration=2.803705183 podStartE2EDuration="5.756303104s" totalImagesPullingTime="2.952597921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:50.755549784 +0000 UTC m=+40.784790699" watchObservedRunningTime="2026-07-29 01:10:50.756303104 +0000 UTC m=+40.785544018"
Jul 29 01:10:51.968883 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:51.968843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:52.062998 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:52.062954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:52.437063 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:52.437031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:53.239109 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:53.239069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:10:53.239109 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:53.239113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239205    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239206    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239216    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239271    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:01.239256841 +0000 UTC m=+51.268497733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239285    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:01.239279734 +0000 UTC m=+51.268520626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:10:53.239318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239390    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:53.239526 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:10:53.239417    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:01.239411403 +0000 UTC m=+51.268652294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:00.893042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:00.893005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:01.300669 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:01.300630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:01.300683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:01.300706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300789    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300804    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300815    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300789    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:11:01.300851 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300854    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:17.300837315 +0000 UTC m=+67.330078207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.301064 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:17.300860519 +0000 UTC m=+67.330101411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:11:01.301064 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:01.300887    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:17.300877617 +0000 UTC m=+67.330118508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:11:03.337912 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:03.337873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:03.521418 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:03.521378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:03.980983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:03.980950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:04.082880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:04.082843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:11.720445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:11.720404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xfz5"
Jul 29 01:11:11.869451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:11.869421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:11.970131 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:11.970099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:12.973014 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:12.972978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:13.103172 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:13.103139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:16.114666 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.114618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:11:16.117082 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.117060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:11:16.125836 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:16.125805    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:11:16.125920 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:16.125901    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:12:20.125879536 +0000 UTC m=+130.155120428 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : secret "metrics-daemon-secret" not found
Jul 29 01:11:16.215839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.215804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:11:16.218046 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.218025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:11:16.228488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.228463    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:11:16.241213 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.241179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5p6\" (UniqueName: \"kubernetes.io/projected/c0844f6a-b04a-4167-8a6e-b4be9e6263a6-kube-api-access-jw5p6\") pod \"network-check-target-4m74x\" (UID: \"c0844f6a-b04a-4167-8a6e-b4be9e6263a6\") " pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:11:16.316903 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.316865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:11:16.319219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.319199    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:11:16.330407 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.330377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc-original-pull-secret\") pod \"global-pull-secret-syncer-lg88h\" (UID: \"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc\") " pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:11:16.376380 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.376280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg88h"
Jul 29 01:11:16.385547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.385492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d72dr\""
Jul 29 01:11:16.393673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.393644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:11:16.524899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.524863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg88h"]
Jul 29 01:11:16.528468 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:11:16.528441    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aef0f5e_99c0_49bb_93ca_911a9ff3b3cc.slice/crio-caefc71b5c2f2864e511f41200bac703265e8eeb9c5dc02d26660f7588bdbf0b WatchSource:0}: Error finding container caefc71b5c2f2864e511f41200bac703265e8eeb9c5dc02d26660f7588bdbf0b: Status 404 returned error can't find the container with id caefc71b5c2f2864e511f41200bac703265e8eeb9c5dc02d26660f7588bdbf0b
Jul 29 01:11:16.548856 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.548826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4m74x"]
Jul 29 01:11:16.551781 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:11:16.551754    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0844f6a_b04a_4167_8a6e_b4be9e6263a6.slice/crio-b7eed55335275bdfa906f2111f90ca868107c0203c894ea4b831fc99c76b7510 WatchSource:0}: Error finding container b7eed55335275bdfa906f2111f90ca868107c0203c894ea4b831fc99c76b7510: Status 404 returned error can't find the container with id b7eed55335275bdfa906f2111f90ca868107c0203c894ea4b831fc99c76b7510
Jul 29 01:11:16.802993 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.802953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4m74x" event={"ID":"c0844f6a-b04a-4167-8a6e-b4be9e6263a6","Type":"ContainerStarted","Data":"b7eed55335275bdfa906f2111f90ca868107c0203c894ea4b831fc99c76b7510"}
Jul 29 01:11:16.804257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:16.804235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg88h" event={"ID":"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc","Type":"ContainerStarted","Data":"caefc71b5c2f2864e511f41200bac703265e8eeb9c5dc02d26660f7588bdbf0b"}
Jul 29 01:11:17.325369 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:17.325311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:17.325398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325496    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325572    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:49.325549912 +0000 UTC m=+99.354790808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325599    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325611    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325622    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:17.325499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325658    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:49.325641636 +0000 UTC m=+99.354882541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:11:17.325962 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:17.325683    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:49.325676308 +0000 UTC m=+99.354917199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:11:21.820302 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:21.820259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4m74x" event={"ID":"c0844f6a-b04a-4167-8a6e-b4be9e6263a6","Type":"ContainerStarted","Data":"69dbfa4fdcf3427aac54e673397a2e669b015a163d69844529017602a282314f"}
Jul 29 01:11:21.820798 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:21.820374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:11:21.821640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:21.821616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg88h" event={"ID":"6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc","Type":"ContainerStarted","Data":"aaf6d4252c5c78903d0bbfb21279729a78e13b9cb135ff89cf896732168508e5"}
Jul 29 01:11:21.835720 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:21.835668    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4m74x" podStartSLOduration=67.190681209 podStartE2EDuration="1m11.835652563s" totalImagesPullingTime="4.644971354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:21.834153855 +0000 UTC m=+71.863394779" watchObservedRunningTime="2026-07-29 01:11:21.835652563 +0000 UTC m=+71.864893477"
Jul 29 01:11:21.848506 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:21.848454    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lg88h" podStartSLOduration=67.174391121 podStartE2EDuration="1m11.84843485s" totalImagesPullingTime="4.674043729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:21.848230662 +0000 UTC m=+71.877471567" watchObservedRunningTime="2026-07-29 01:11:21.84843485 +0000 UTC m=+71.877675763"
Jul 29 01:11:24.286379 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:24.286343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:24.387956 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:24.387920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:49.364459 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:49.364406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:11:49.364459 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:49.364470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:49.364493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364550    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364622    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364625    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364685    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364677    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:53.364659818 +0000 UTC m=+163.393900710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364723    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:12:53.364708024 +0000 UTC m=+163.393948916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:11:49.365017 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:11:49.364735    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:53.364728924 +0000 UTC m=+163.393969815 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:11:52.827066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:11:52.827027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4m74x"
Jul 29 01:12:20.194462 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:20.194418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:12:20.194901 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:20.194536    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:12:20.194901 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:20.194628    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:14:22.194612079 +0000 UTC m=+252.223852970 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : secret "metrics-daemon-secret" not found
Jul 29 01:12:48.421756 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:48.421693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"
Jul 29 01:12:48.429995 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:48.429964    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh" podUID="f94b01dd-72c4-4d2b-83b2-b69e35c4162a"
Jul 29 01:12:48.444161 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:48.444134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5j2zt" podUID="a6cb163e-59ae-40c0-ab81-952320ea89b9"
Jul 29 01:12:48.492288 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:48.492245    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:12:49.027941 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:49.027909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:12:49.027941 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:49.027934    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:12:49.028146 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:49.028103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:12:53.445633 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:53.445596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:12:53.445633 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:53.445640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:12:53.445664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445745    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445758    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445772    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b49f8796c-4n9lr: secret "image-registry-tls" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445769    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445830    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls podName:a6cb163e-59ae-40c0-ab81-952320ea89b9 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:55.445812574 +0000 UTC m=+285.475053471 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls") pod "dns-default-5j2zt" (UID: "a6cb163e-59ae-40c0-ab81-952320ea89b9") : secret "dns-default-metrics-tls" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445844    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls podName:1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:55.445837917 +0000 UTC m=+285.475078809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls") pod "image-registry-b49f8796c-4n9lr" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5") : secret "image-registry-tls" not found
Jul 29 01:12:53.446146 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:12:53.445855    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert podName:f94b01dd-72c4-4d2b-83b2-b69e35c4162a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:55.445849834 +0000 UTC m=+285.475090726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mhcfh" (UID: "f94b01dd-72c4-4d2b-83b2-b69e35c4162a") : secret "networking-console-plugin-cert" not found
Jul 29 01:13:02.464019 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:13:02.463936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:13:42.064098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:13:42.064056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:22.274314 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:22.274274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:14:22.274929 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:22.274441    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:14:22.274929 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:22.274523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs podName:f9051c65-4011-4559-9ac5-9f8bdf5e6bee nodeName:}" failed. No retries permitted until 2026-07-29 01:16:24.274499082 +0000 UTC m=+374.303739976 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs") pod "network-metrics-daemon-hxcqh" (UID: "f9051c65-4011-4559-9ac5-9f8bdf5e6bee") : secret "metrics-daemon-secret" not found
Jul 29 01:14:31.688374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.688284    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"]
Jul 29 01:14:31.691073 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.691057    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"]
Jul 29 01:14:31.691188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.691169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.693786 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.693766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.697117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.697094    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 01:14:31.697257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.697226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 01:14:31.697257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.697232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.697370 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.697246    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.697370 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.697328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h8cdm\""
Jul 29 01:14:31.701628 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.701608    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.701756 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.701741    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 01:14:31.701820 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.701770    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.701820 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.701793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rddj2\""
Jul 29 01:14:31.718243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.718213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"]
Jul 29 01:14:31.723311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.723286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"]
Jul 29 01:14:31.785367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.785333    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"]
Jul 29 01:14:31.788290 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.788274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.790506 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.790488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h588g\""
Jul 29 01:14:31.790647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.790618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.790761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.790617    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 01:14:31.790761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.790680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 01:14:31.790937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.790851    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.796029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.796007    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"]
Jul 29 01:14:31.799207 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.799188    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8v9jv"]
Jul 29 01:14:31.799326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.799311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"
Jul 29 01:14:31.801799 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.801780    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.801936 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.801916    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-88848ff99-95vmc"]
Jul 29 01:14:31.802040 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.802020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.802290 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.802267    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.803479 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.803463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nvkf7\""
Jul 29 01:14:31.804877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.804860    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.805016 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.804879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"]
Jul 29 01:14:31.805087 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.804947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.805146 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.805120    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.805540 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.805518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 01:14:31.805664 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.805649    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fxgln\""
Jul 29 01:14:31.806049 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.806009    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 01:14:31.808126 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808107    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.808457 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808438    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 01:14:31.808553 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808512    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 01:14:31.808648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808560    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.808648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6wxgh\""
Jul 29 01:14:31.808648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 01:14:31.808962 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.808948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 01:14:31.812147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.812036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"]
Jul 29 01:14:31.813211 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.813189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8v9jv"]
Jul 29 01:14:31.815797 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.815777    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 01:14:31.816941 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.816920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-88848ff99-95vmc"]
Jul 29 01:14:31.840117 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/965e3f45-1d4a-428e-9126-b031fb1ba11f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.840261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rnn\" (UniqueName: \"kubernetes.io/projected/965e3f45-1d4a-428e-9126-b031fb1ba11f-kube-api-access-58rnn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.840261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxwf\" (UniqueName: \"kubernetes.io/projected/300e21fd-6a8a-44ff-8b23-b88743eed8fb-kube-api-access-dbxwf\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.840261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b269050-1777-4a66-be63-59aa402f9c94-serving-cert\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.840386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbjh\" (UniqueName: \"kubernetes.io/projected/2b269050-1777-4a66-be63-59aa402f9c94-kube-api-access-bnbjh\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.840386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/965e3f45-1d4a-428e-9126-b031fb1ba11f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.840386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b269050-1777-4a66-be63-59aa402f9c94-config\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.840386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.840361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.941474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-default-certificate\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.941474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdvd\" (UniqueName: \"kubernetes.io/projected/4d6270cf-5a84-4767-8299-da274feb9c8a-kube-api-access-nsdvd\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.941474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/965e3f45-1d4a-428e-9126-b031fb1ba11f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b269050-1777-4a66-be63-59aa402f9c94-serving-cert\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b269050-1777-4a66-be63-59aa402f9c94-config\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-stats-auth\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z48\" (UniqueName: \"kubernetes.io/projected/094e4f68-d28a-4711-b9b4-9d43bd9291db-kube-api-access-k8z48\") pod \"volume-data-source-validator-549c6d54cf-7lv5w\" (UID: \"094e4f68-d28a-4711-b9b4-9d43bd9291db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rnn\" (UniqueName: \"kubernetes.io/projected/965e3f45-1d4a-428e-9126-b031fb1ba11f-kube-api-access-58rnn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.941785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-serving-cert\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-service-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.941973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxwf\" (UniqueName: \"kubernetes.io/projected/300e21fd-6a8a-44ff-8b23-b88743eed8fb-kube-api-access-dbxwf\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/965e3f45-1d4a-428e-9126-b031fb1ba11f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bktmp\" (UniqueName: \"kubernetes.io/projected/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-kube-api-access-bktmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-snapshots\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbjh\" (UniqueName: \"kubernetes.io/projected/2b269050-1777-4a66-be63-59aa402f9c94-kube-api-access-bnbjh\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-tmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:31.942236    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:31.942294    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls podName:300e21fd-6a8a-44ff-8b23-b88743eed8fb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:32.442281781 +0000 UTC m=+262.471522672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls") pod "cluster-samples-operator-6748489656-cbhsr" (UID: "300e21fd-6a8a-44ff-8b23-b88743eed8fb") : secret "samples-operator-tls" not found
Jul 29 01:14:31.942624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b269050-1777-4a66-be63-59aa402f9c94-config\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.942935 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.942773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/965e3f45-1d4a-428e-9126-b031fb1ba11f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.944105 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.944080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/965e3f45-1d4a-428e-9126-b031fb1ba11f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.944203 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.944110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b269050-1777-4a66-be63-59aa402f9c94-serving-cert\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.954873 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.954842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxwf\" (UniqueName: \"kubernetes.io/projected/300e21fd-6a8a-44ff-8b23-b88743eed8fb-kube-api-access-dbxwf\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:31.954988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.954848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rnn\" (UniqueName: \"kubernetes.io/projected/965e3f45-1d4a-428e-9126-b031fb1ba11f-kube-api-access-58rnn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg\" (UID: \"965e3f45-1d4a-428e-9126-b031fb1ba11f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:31.955054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.955038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbjh\" (UniqueName: \"kubernetes.io/projected/2b269050-1777-4a66-be63-59aa402f9c94-kube-api-access-bnbjh\") pod \"service-ca-operator-5d6c75f84f-65wpm\" (UID: \"2b269050-1777-4a66-be63-59aa402f9c94\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:31.955418 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:31.955401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:32.001379 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.001342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"
Jul 29 01:14:32.042691 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bktmp\" (UniqueName: \"kubernetes.io/projected/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-kube-api-access-bktmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-snapshots\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-tmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-default-certificate\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdvd\" (UniqueName: \"kubernetes.io/projected/4d6270cf-5a84-4767-8299-da274feb9c8a-kube-api-access-nsdvd\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.042844 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.042816    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-stats-auth\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.042893    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:32.542871348 +0000 UTC m=+262.572112240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : secret "router-metrics-certs-default" not found
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z48\" (UniqueName: \"kubernetes.io/projected/094e4f68-d28a-4711-b9b4-9d43bd9291db-kube-api-access-k8z48\") pod \"volume-data-source-validator-549c6d54cf-7lv5w\" (UID: \"094e4f68-d28a-4711-b9b4-9d43bd9291db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.042985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-serving-cert\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.043008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-service-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043318 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.043207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-tmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043774 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.043558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-snapshots\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043774 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.043619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-service-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.043774 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.043742    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:32.543721968 +0000 UTC m=+262.572962860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:32.044633 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.044606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.045784 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.045745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:32.045784 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.045778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-default-certificate\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.045921 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.045778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-stats-auth\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.045988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.045971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-serving-cert\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.052337 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.052305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bktmp\" (UniqueName: \"kubernetes.io/projected/1e5cc00a-5347-4c46-9017-8f0c1fb5e593-kube-api-access-bktmp\") pod \"insights-operator-5885fdb759-8v9jv\" (UID: \"1e5cc00a-5347-4c46-9017-8f0c1fb5e593\") " pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.052708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.052683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z48\" (UniqueName: \"kubernetes.io/projected/094e4f68-d28a-4711-b9b4-9d43bd9291db-kube-api-access-k8z48\") pod \"volume-data-source-validator-549c6d54cf-7lv5w\" (UID: \"094e4f68-d28a-4711-b9b4-9d43bd9291db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"
Jul 29 01:14:32.052926 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.052708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdvd\" (UniqueName: \"kubernetes.io/projected/4d6270cf-5a84-4767-8299-da274feb9c8a-kube-api-access-nsdvd\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.098132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.098022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"
Jul 29 01:14:32.110297 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.110271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"
Jul 29 01:14:32.119182 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.119152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8v9jv"
Jul 29 01:14:32.129314 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.129285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg"]
Jul 29 01:14:32.133875 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:32.133837    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965e3f45_1d4a_428e_9126_b031fb1ba11f.slice/crio-485f8192719cac840e667d5d3395441307539a02718d30ecf09b8fdf3a70e4d5 WatchSource:0}: Error finding container 485f8192719cac840e667d5d3395441307539a02718d30ecf09b8fdf3a70e4d5: Status 404 returned error can't find the container with id 485f8192719cac840e667d5d3395441307539a02718d30ecf09b8fdf3a70e4d5
Jul 29 01:14:32.241765 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.241694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm"]
Jul 29 01:14:32.246769 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:32.246739    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b269050_1777_4a66_be63_59aa402f9c94.slice/crio-963b0217c929813cac4907edddb0514bd98efffffd5e737b1e2426df436780b5 WatchSource:0}: Error finding container 963b0217c929813cac4907edddb0514bd98efffffd5e737b1e2426df436780b5: Status 404 returned error can't find the container with id 963b0217c929813cac4907edddb0514bd98efffffd5e737b1e2426df436780b5
Jul 29 01:14:32.258202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.258169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w"]
Jul 29 01:14:32.261803 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:32.261777    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094e4f68_d28a_4711_b9b4_9d43bd9291db.slice/crio-c969eed17d16e93eaa44580daf7106abcd5f206b867a1b515362acbf8c39f775 WatchSource:0}: Error finding container c969eed17d16e93eaa44580daf7106abcd5f206b867a1b515362acbf8c39f775: Status 404 returned error can't find the container with id c969eed17d16e93eaa44580daf7106abcd5f206b867a1b515362acbf8c39f775
Jul 29 01:14:32.266593 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.266551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w" event={"ID":"094e4f68-d28a-4711-b9b4-9d43bd9291db","Type":"ContainerStarted","Data":"c969eed17d16e93eaa44580daf7106abcd5f206b867a1b515362acbf8c39f775"}
Jul 29 01:14:32.267628 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.267606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm" event={"ID":"2b269050-1777-4a66-be63-59aa402f9c94","Type":"ContainerStarted","Data":"963b0217c929813cac4907edddb0514bd98efffffd5e737b1e2426df436780b5"}
Jul 29 01:14:32.268665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.268640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg" event={"ID":"965e3f45-1d4a-428e-9126-b031fb1ba11f","Type":"ContainerStarted","Data":"485f8192719cac840e667d5d3395441307539a02718d30ecf09b8fdf3a70e4d5"}
Jul 29 01:14:32.277618 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.277596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8v9jv"]
Jul 29 01:14:32.280208 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:32.280179    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5cc00a_5347_4c46_9017_8f0c1fb5e593.slice/crio-1207595d43556d61499c280b0dd04559747c3be5ca69fd1d16bbe1a4e477be7b WatchSource:0}: Error finding container 1207595d43556d61499c280b0dd04559747c3be5ca69fd1d16bbe1a4e477be7b: Status 404 returned error can't find the container with id 1207595d43556d61499c280b0dd04559747c3be5ca69fd1d16bbe1a4e477be7b
Jul 29 01:14:32.446955 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.446916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:32.447157 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.447093    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:14:32.447222 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.447172    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls podName:300e21fd-6a8a-44ff-8b23-b88743eed8fb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:33.447151301 +0000 UTC m=+263.476392212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls") pod "cluster-samples-operator-6748489656-cbhsr" (UID: "300e21fd-6a8a-44ff-8b23-b88743eed8fb") : secret "samples-operator-tls" not found
Jul 29 01:14:32.548399 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.548356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.548619 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:32.548448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:32.548619 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.548504    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:33.548483749 +0000 UTC m=+263.577724641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:32.548619 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.548555    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:14:32.548791 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:32.548634    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:33.548618392 +0000 UTC m=+263.577859284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : secret "router-metrics-certs-default" not found
Jul 29 01:14:33.277613 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:33.276359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8v9jv" event={"ID":"1e5cc00a-5347-4c46-9017-8f0c1fb5e593","Type":"ContainerStarted","Data":"1207595d43556d61499c280b0dd04559747c3be5ca69fd1d16bbe1a4e477be7b"}
Jul 29 01:14:33.456979 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:33.456932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:33.457152 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:33.457096    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:14:33.457209 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:33.457174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls podName:300e21fd-6a8a-44ff-8b23-b88743eed8fb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.457151319 +0000 UTC m=+265.486392211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls") pod "cluster-samples-operator-6748489656-cbhsr" (UID: "300e21fd-6a8a-44ff-8b23-b88743eed8fb") : secret "samples-operator-tls" not found
Jul 29 01:14:33.557476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:33.557438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:33.557640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:33.557542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:33.558119 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:33.557864    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.557842656 +0000 UTC m=+265.587083549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:33.558119 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:33.557914    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:14:33.558119 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:33.557969    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.557956763 +0000 UTC m=+265.587197655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : secret "router-metrics-certs-default" not found
Jul 29 01:14:34.281079 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:34.281042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w" event={"ID":"094e4f68-d28a-4711-b9b4-9d43bd9291db","Type":"ContainerStarted","Data":"f73ab0c9e11b59f432df53e86619388b8cf8fed633167ffa25e00e60a4997ac4"}
Jul 29 01:14:34.295754 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:34.295702    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7lv5w" podStartSLOduration=2.046862027 podStartE2EDuration="3.295686496s" totalImagesPullingTime="1.248824469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:34.294873973 +0000 UTC m=+264.324114899" watchObservedRunningTime="2026-07-29 01:14:34.295686496 +0000 UTC m=+264.324927410"
Jul 29 01:14:34.380118 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:34.380083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:35.286422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.286382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm" event={"ID":"2b269050-1777-4a66-be63-59aa402f9c94","Type":"ContainerStarted","Data":"cda5a956151d771c0697f38a5cf274b54f8146d30b3ff2ac8bb27524ad6fcc9a"}
Jul 29 01:14:35.288106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.288077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg" event={"ID":"965e3f45-1d4a-428e-9126-b031fb1ba11f","Type":"ContainerStarted","Data":"c3959fc938b42b8e2e4be33e0aebd19fb09b55ce22438f47c637b84d0e56c824"}
Jul 29 01:14:35.289747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.289721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8v9jv" event={"ID":"1e5cc00a-5347-4c46-9017-8f0c1fb5e593","Type":"ContainerStarted","Data":"53e96eecef6d48f8f758e3c4ca877e52265cad368b7318f107823e1e120ffa39"}
Jul 29 01:14:35.301545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.301489    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm" podStartSLOduration=1.392525473 podStartE2EDuration="4.301476588s" totalImagesPullingTime="2.908951115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:35.30034286 +0000 UTC m=+265.329583775" watchObservedRunningTime="2026-07-29 01:14:35.301476588 +0000 UTC m=+265.330717502"
Jul 29 01:14:35.314309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.314027    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg" podStartSLOduration=1.299487471 podStartE2EDuration="4.314008896s" totalImagesPullingTime="3.014521425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:35.313335499 +0000 UTC m=+265.342576414" watchObservedRunningTime="2026-07-29 01:14:35.314008896 +0000 UTC m=+265.343249811"
Jul 29 01:14:35.331560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.331505    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-8v9jv" podStartSLOduration=1.460100756 podStartE2EDuration="4.331490338s" totalImagesPullingTime="2.871389582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:35.330640962 +0000 UTC m=+265.359881877" watchObservedRunningTime="2026-07-29 01:14:35.331490338 +0000 UTC m=+265.360731252"
Jul 29 01:14:35.475415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.475311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:35.475597 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:35.475485    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:14:35.475597 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:35.475590    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls podName:300e21fd-6a8a-44ff-8b23-b88743eed8fb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.475554926 +0000 UTC m=+269.504795825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls") pod "cluster-samples-operator-6748489656-cbhsr" (UID: "300e21fd-6a8a-44ff-8b23-b88743eed8fb") : secret "samples-operator-tls" not found
Jul 29 01:14:35.576657 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.576623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:35.576832 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:35.576720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:35.576832 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:35.576797    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:14:35.576832 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:35.576831    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.576815179 +0000 UTC m=+269.606056072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:35.577002 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:35.576862    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.576842987 +0000 UTC m=+269.606083882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : secret "router-metrics-certs-default" not found
Jul 29 01:14:36.250254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.250218    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dl7c2"]
Jul 29 01:14:36.255195 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.255165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.257855 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.257832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:14:36.258078 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.258060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:14:36.258271 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.258258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2fjq\""
Jul 29 01:14:36.276655 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.276626    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dl7c2"]
Jul 29 01:14:36.301531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.301483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:36.321407 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.321371    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"]
Jul 29 01:14:36.324461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.324438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"
Jul 29 01:14:36.327409 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.327388    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 01:14:36.327823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.327802    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:36.327923 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.327861    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-df8gb\""
Jul 29 01:14:36.336366 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.336340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"]
Jul 29 01:14:36.383512 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.383463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5ca0e97-8159-4564-af2a-133d8cc0ab88-crio-socket\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.383512 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.383515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.383906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.383880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5ca0e97-8159-4564-af2a-133d8cc0ab88-data-volume\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.383957 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.383939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkz9\" (UniqueName: \"kubernetes.io/projected/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-api-access-qmkz9\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.384198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.384162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.432187 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.432152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:36.485621 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5ca0e97-8159-4564-af2a-133d8cc0ab88-data-volume\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.485787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkz9\" (UniqueName: \"kubernetes.io/projected/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-api-access-qmkz9\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.485787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4mdz\" (UniqueName: \"kubernetes.io/projected/f5545389-4c02-41c5-bf73-d9b10c7e035a-kube-api-access-c4mdz\") pod \"migrator-6865c9967-j244n\" (UID: \"f5545389-4c02-41c5-bf73-d9b10c7e035a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"
Jul 29 01:14:36.485787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.485960 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.485826    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.485960 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.485876    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:36.98586222 +0000 UTC m=+267.015103112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.485960 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5ca0e97-8159-4564-af2a-133d8cc0ab88-crio-socket\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.485960 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.485960 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5ca0e97-8159-4564-af2a-133d8cc0ab88-crio-socket\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.486127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.485958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5ca0e97-8159-4564-af2a-133d8cc0ab88-data-volume\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.486127 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.486009    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.486127 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.486045    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:36.986037577 +0000 UTC m=+267.015278469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.493898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.493873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkz9\" (UniqueName: \"kubernetes.io/projected/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-api-access-qmkz9\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.535141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.535064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:36.586353 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.586314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4mdz\" (UniqueName: \"kubernetes.io/projected/f5545389-4c02-41c5-bf73-d9b10c7e035a-kube-api-access-c4mdz\") pod \"migrator-6865c9967-j244n\" (UID: \"f5545389-4c02-41c5-bf73-d9b10c7e035a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"
Jul 29 01:14:36.596643 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.596621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4mdz\" (UniqueName: \"kubernetes.io/projected/f5545389-4c02-41c5-bf73-d9b10c7e035a-kube-api-access-c4mdz\") pod \"migrator-6865c9967-j244n\" (UID: \"f5545389-4c02-41c5-bf73-d9b10c7e035a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"
Jul 29 01:14:36.636730 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.636699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"
Jul 29 01:14:36.685532 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.685489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:36.744772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.744737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:36.763256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.763226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-j244n"]
Jul 29 01:14:36.766226 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:36.766196    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5545389_4c02_41c5_bf73_d9b10c7e035a.slice/crio-fbd08e37cd1329fafac3f2fe1eb8dc95a7edc9c16d84b19c9c15bdb1e0050822 WatchSource:0}: Error finding container fbd08e37cd1329fafac3f2fe1eb8dc95a7edc9c16d84b19c9c15bdb1e0050822: Status 404 returned error can't find the container with id fbd08e37cd1329fafac3f2fe1eb8dc95a7edc9c16d84b19c9c15bdb1e0050822
Jul 29 01:14:36.990060 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.989977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.990060 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:36.990028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:36.990242 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.990096    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.990242 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.990144    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.990242 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.990157    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:37.990142852 +0000 UTC m=+268.019383745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.990242 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:36.990203    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:37.990191854 +0000 UTC m=+268.019432746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:37.120953 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.120917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:37.178093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.178049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:37.298394 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.298351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n" event={"ID":"f5545389-4c02-41c5-bf73-d9b10c7e035a","Type":"ContainerStarted","Data":"fbd08e37cd1329fafac3f2fe1eb8dc95a7edc9c16d84b19c9c15bdb1e0050822"}
Jul 29 01:14:37.389338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.389302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:37.490063 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.490034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:37.999347 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.999314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:37.999506 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:37.999438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:37.999506 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:37.999466    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:37.999596 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:37.999522    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:37.999596 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:37.999530    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.999514801 +0000 UTC m=+270.028755697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:37.999596 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:37.999562    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.999551432 +0000 UTC m=+270.028792323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:38.254139 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:38.254118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nrv2q_26e9e02f-12de-4e5b-a6fc-ede1e0fd2022/dns-node-resolver/0.log"
Jul 29 01:14:38.303339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:38.303297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n" event={"ID":"f5545389-4c02-41c5-bf73-d9b10c7e035a","Type":"ContainerStarted","Data":"1bed1b45379f997151fcf0ef505f0eb0f85c5453c5976e38510ae1415b7e8600"}
Jul 29 01:14:38.303493 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:38.303351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n" event={"ID":"f5545389-4c02-41c5-bf73-d9b10c7e035a","Type":"ContainerStarted","Data":"6578e1f205c013384fa33872cace605deaa21ac4a04e5b19aa96f4d3426a9044"}
Jul 29 01:14:38.318994 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:38.318940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-j244n" podStartSLOduration=1.315868333 podStartE2EDuration="2.318924844s" totalImagesPullingTime="1.003056511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:38.317620937 +0000 UTC m=+268.346861855" watchObservedRunningTime="2026-07-29 01:14:38.318924844 +0000 UTC m=+268.348165758"
Jul 29 01:14:38.393710 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:38.393662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:39.040612 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.040570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:39.053823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.053796    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5tgf_deaa41ae-5ccc-4706-8f61-4c6f2f97cd92/node-ca/0.log"
Jul 29 01:14:39.141705 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.141674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:39.511670 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.511635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:39.512030 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:39.511788    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:14:39.512030 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:39.511857    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls podName:300e21fd-6a8a-44ff-8b23-b88743eed8fb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:47.511840531 +0000 UTC m=+277.541081614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls") pod "cluster-samples-operator-6748489656-cbhsr" (UID: "300e21fd-6a8a-44ff-8b23-b88743eed8fb") : secret "samples-operator-tls" not found
Jul 29 01:14:39.612223 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.612187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:39.612375 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.612269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:39.612375 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:39.612352    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:47.612335104 +0000 UTC m=+277.641575998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:39.612459 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:39.612384    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:14:39.612459 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:39.612425    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:47.612414817 +0000 UTC m=+277.641655709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : secret "router-metrics-certs-default" not found
Jul 29 01:14:39.854922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:39.854853    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9ptcc_2bc4543b-3ba8-4273-95e8-a258faa03958/serve-healthcheck-canary/0.log"
Jul 29 01:14:40.015836 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:40.015800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:40.016003 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:40.015852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:40.016003 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:40.015929    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:40.016003 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:40.015992    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:44.015977771 +0000 UTC m=+274.045218664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:40.016003 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:40.015999    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:40.016141 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:40.016041    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:44.016030432 +0000 UTC m=+274.045271327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:40.024215 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:40.024187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.021489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.021447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.123525 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.123495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.224442 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.224412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.289331 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.289232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.354047 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.354017    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.783777 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.783747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:42.921088 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:42.921052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:43.554526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:43.554469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:44.053949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.053914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:44.054162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.053983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:44.054162 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:44.054042    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:44.054162 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:44.054087    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:44.054162 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:44.054111    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:52.054094762 +0000 UTC m=+282.083335658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:44.054162 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:44.054149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:52.054134115 +0000 UTC m=+282.083375020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:44.136183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.136136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:44.323344 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.323264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:44.732472 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.732396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:44.934833 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:44.934803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:45.321850 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:45.321823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:45.922990 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:45.922956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:45.977363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:45.977331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:46.120943 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:46.120908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:46.523029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:46.522995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:46.723528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:46.723501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:46.926555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:46.926482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:47.032609 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.032561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:47.131358 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.131323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:47.187353 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.187265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:47.587493 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.587446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:47.589987 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.589958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/300e21fd-6a8a-44ff-8b23-b88743eed8fb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-cbhsr\" (UID: \"300e21fd-6a8a-44ff-8b23-b88743eed8fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:47.606866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.606840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"
Jul 29 01:14:47.688412 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.688386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:47.688555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.688475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:47.688647 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:47.688554    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle podName:4d6270cf-5a84-4767-8299-da274feb9c8a nodeName:}" failed. No retries permitted until 2026-07-29 01:15:03.688535336 +0000 UTC m=+293.717776232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle") pod "router-default-88848ff99-95vmc" (UID: "4d6270cf-5a84-4767-8299-da274feb9c8a") : configmap references non-existent config key: service-ca.crt
Jul 29 01:14:47.691153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.691126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d6270cf-5a84-4767-8299-da274feb9c8a-metrics-certs\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:14:47.732919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:47.732890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr"]
Jul 29 01:14:48.326673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.326638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:48.335559 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.335521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr" event={"ID":"300e21fd-6a8a-44ff-8b23-b88743eed8fb","Type":"ContainerStarted","Data":"a0afaa24e030c101fb9ed37a57f73a510da3e54ea6f3f1fc228758dfaa115243"}
Jul 29 01:14:48.533335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.533297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:48.594790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.594692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:48.725291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.725250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:48.922877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:48.922792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:49.129833 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:49.129800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:50.323660 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.323621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:50.343490 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.343457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr" event={"ID":"300e21fd-6a8a-44ff-8b23-b88743eed8fb","Type":"ContainerStarted","Data":"9c5f6400ad97aae1c27fa04fbb073244ee3f8066f7536a6d371ece372fafd244"}
Jul 29 01:14:50.343691 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.343511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr" event={"ID":"300e21fd-6a8a-44ff-8b23-b88743eed8fb","Type":"ContainerStarted","Data":"10af60d8cf216a32f59f0c661fbd738fe33ef420fe765cf370efeae2c74b459b"}
Jul 29 01:14:50.365203 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.365150    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-cbhsr" podStartSLOduration=17.729218176 podStartE2EDuration="19.365135123s" totalImagesPullingTime="1.635916947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:50.36382397 +0000 UTC m=+280.393064886" watchObservedRunningTime="2026-07-29 01:14:50.365135123 +0000 UTC m=+280.394376063"
Jul 29 01:14:50.525623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.525565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:50.725286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.725210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:50.922164 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:50.922136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:51.124351 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:51.124317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:51.189951 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:51.189920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:51.823944 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:51.823913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:51.922017 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:51.921983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:52.028976 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:52.028933    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh" podUID="f94b01dd-72c4-4d2b-83b2-b69e35c4162a"
Jul 29 01:14:52.028976 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:52.028933    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5j2zt" podUID="a6cb163e-59ae-40c0-ab81-952320ea89b9"
Jul 29 01:14:52.028976 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:52.028948    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"
Jul 29 01:14:52.123291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.123212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:52.123291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.123258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:52.123477 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:52.123370    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:52.123477 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:14:52.123432    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls podName:c5ca0e97-8159-4564-af2a-133d8cc0ab88 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:08.123413662 +0000 UTC m=+298.152654562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dl7c2" (UID: "c5ca0e97-8159-4564-af2a-133d8cc0ab88") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:52.123788 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.123765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5ca0e97-8159-4564-af2a-133d8cc0ab88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:14:52.132842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.132820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:52.324760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.324724    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:52.350039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.350006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:14:52.350039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.350016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:14:52.350039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.350007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:14:52.762360 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:52.762311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:55.450018 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.449983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:14:55.450018 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.450026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:14:55.450445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.450084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:14:55.452738 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.452709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cb163e-59ae-40c0-ab81-952320ea89b9-metrics-tls\") pod \"dns-default-5j2zt\" (UID: \"a6cb163e-59ae-40c0-ab81-952320ea89b9\") " pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:14:55.452858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.452781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"image-registry-b49f8796c-4n9lr\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") " pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:14:55.452858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.452806    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f94b01dd-72c4-4d2b-83b2-b69e35c4162a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mhcfh\" (UID: \"f94b01dd-72c4-4d2b-83b2-b69e35c4162a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:14:55.653685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.653657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cdts5\""
Jul 29 01:14:55.653685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.653659    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mpdbl\""
Jul 29 01:14:55.653894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.653661    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rpdf\""
Jul 29 01:14:55.661519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.661501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"
Jul 29 01:14:55.661614 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.661538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:14:55.661614 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.661599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:14:55.819350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.819209    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5j2zt"]
Jul 29 01:14:55.821863 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:55.821837    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cb163e_59ae_40c0_ab81_952320ea89b9.slice/crio-f1914f971292e802d245a068ea10e345a3c60f3c32aab30384066b353cf895c1 WatchSource:0}: Error finding container f1914f971292e802d245a068ea10e345a3c60f3c32aab30384066b353cf895c1: Status 404 returned error can't find the container with id f1914f971292e802d245a068ea10e345a3c60f3c32aab30384066b353cf895c1
Jul 29 01:14:55.834391 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.834367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh"]
Jul 29 01:14:55.837759 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:55.837732    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94b01dd_72c4_4d2b_83b2_b69e35c4162a.slice/crio-13e6575fca4637d0c736134b1a2c1e37ca58537484f9394600b31d0fb9498595 WatchSource:0}: Error finding container 13e6575fca4637d0c736134b1a2c1e37ca58537484f9394600b31d0fb9498595: Status 404 returned error can't find the container with id 13e6575fca4637d0c736134b1a2c1e37ca58537484f9394600b31d0fb9498595
Jul 29 01:14:55.855217 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:55.855190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:14:55.857991 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:14:55.857959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccb72b4_7334_4ee7_bcdd_bb6b4a2125a5.slice/crio-b23b54323e548847aec0dfa90e7da07f17258c18d3acf6b4b9fa57ba74d093ac WatchSource:0}: Error finding container b23b54323e548847aec0dfa90e7da07f17258c18d3acf6b4b9fa57ba74d093ac: Status 404 returned error can't find the container with id b23b54323e548847aec0dfa90e7da07f17258c18d3acf6b4b9fa57ba74d093ac
Jul 29 01:14:56.363508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.363469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5j2zt" event={"ID":"a6cb163e-59ae-40c0-ab81-952320ea89b9","Type":"ContainerStarted","Data":"f1914f971292e802d245a068ea10e345a3c60f3c32aab30384066b353cf895c1"}
Jul 29 01:14:56.364874 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.364844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" event={"ID":"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5","Type":"ContainerStarted","Data":"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"}
Jul 29 01:14:56.365019 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.364898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:14:56.365019 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.364921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" event={"ID":"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5","Type":"ContainerStarted","Data":"b23b54323e548847aec0dfa90e7da07f17258c18d3acf6b4b9fa57ba74d093ac"}
Jul 29 01:14:56.365974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.365950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh" event={"ID":"f94b01dd-72c4-4d2b-83b2-b69e35c4162a","Type":"ContainerStarted","Data":"13e6575fca4637d0c736134b1a2c1e37ca58537484f9394600b31d0fb9498595"}
Jul 29 01:14:56.386028 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:56.385975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" podStartSLOduration=286.38595503 podStartE2EDuration="4m46.38595503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:56.38398001 +0000 UTC m=+286.413220938" watchObservedRunningTime="2026-07-29 01:14:56.38595503 +0000 UTC m=+286.415195945"
Jul 29 01:14:57.371456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:57.371363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh" event={"ID":"f94b01dd-72c4-4d2b-83b2-b69e35c4162a","Type":"ContainerStarted","Data":"5ab1aa20565b0694b929a8d3fe57e7c70c6fe6ea8f67f3dda231799a1e7c8f23"}
Jul 29 01:14:57.388164 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:57.388116    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mhcfh" podStartSLOduration=286.204186886 podStartE2EDuration="4m47.388100695s" totalImagesPullingTime="1.183913809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:57.386778383 +0000 UTC m=+287.416019296" watchObservedRunningTime="2026-07-29 01:14:57.388100695 +0000 UTC m=+287.417341610"
Jul 29 01:14:58.375989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:58.375955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5j2zt" event={"ID":"a6cb163e-59ae-40c0-ab81-952320ea89b9","Type":"ContainerStarted","Data":"a2b845c719a68bb068b385faf29982a30fad84d3ec8c4478c6d15ffd57e6c4d7"}
Jul 29 01:14:58.376460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:58.376002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5j2zt" event={"ID":"a6cb163e-59ae-40c0-ab81-952320ea89b9","Type":"ContainerStarted","Data":"e06d432c934a59bdad46e3023ca72179ef70a61197aad9b4bc7bdbbdea0f3f6a"}
Jul 29 01:14:58.393920 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:58.393868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5j2zt" podStartSLOduration=251.487857753 podStartE2EDuration="4m13.393849646s" totalImagesPullingTime="1.905991893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:58.392466112 +0000 UTC m=+288.421707026" watchObservedRunningTime="2026-07-29 01:14:58.393849646 +0000 UTC m=+288.423090587"
Jul 29 01:14:59.378870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:14:59.378829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:15:02.942268 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:02.942226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:03.063441 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:03.063407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:03.714385 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:03.714335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:03.714913 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:03.714897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6270cf-5a84-4767-8299-da274feb9c8a-service-ca-bundle\") pod \"router-default-88848ff99-95vmc\" (UID: \"4d6270cf-5a84-4767-8299-da274feb9c8a\") " pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:03.923644 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:03.923589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:04.064131 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.064095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-88848ff99-95vmc"]
Jul 29 01:15:04.066989 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:04.066959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6270cf_5a84_4767_8299_da274feb9c8a.slice/crio-44075d4918a01c4899e1674ed548b16a2ea6092e23e875638a8c5f4acf0fbb90 WatchSource:0}: Error finding container 44075d4918a01c4899e1674ed548b16a2ea6092e23e875638a8c5f4acf0fbb90: Status 404 returned error can't find the container with id 44075d4918a01c4899e1674ed548b16a2ea6092e23e875638a8c5f4acf0fbb90
Jul 29 01:15:04.396097 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.396055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-88848ff99-95vmc" event={"ID":"4d6270cf-5a84-4767-8299-da274feb9c8a","Type":"ContainerStarted","Data":"13afefcc77b1913e7a4c157fb47b7b4cde04ea26e1918699a3575a9b242ae823"}
Jul 29 01:15:04.396275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.396111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-88848ff99-95vmc" event={"ID":"4d6270cf-5a84-4767-8299-da274feb9c8a","Type":"ContainerStarted","Data":"44075d4918a01c4899e1674ed548b16a2ea6092e23e875638a8c5f4acf0fbb90"}
Jul 29 01:15:04.413881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.413836    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-88848ff99-95vmc" podStartSLOduration=33.413818755 podStartE2EDuration="33.413818755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:04.413082346 +0000 UTC m=+294.442323261" watchObservedRunningTime="2026-07-29 01:15:04.413818755 +0000 UTC m=+294.443059669"
Jul 29 01:15:04.801795 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.801762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:04.855089 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.855060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:04.924539 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.924507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:04.927098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:04.927077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:05.399213 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:05.399184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:05.400450 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:05.400430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-88848ff99-95vmc"
Jul 29 01:15:05.464640 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:15:05.464598    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hxcqh" podUID="f9051c65-4011-4559-9ac5-9f8bdf5e6bee"
Jul 29 01:15:05.724567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:05.724479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:05.823373 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:05.823327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:05.894215 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:05.894182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:06.494089 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:06.494060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:08.154276 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.154232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:15:08.156678 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.156656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5ca0e97-8159-4564-af2a-133d8cc0ab88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dl7c2\" (UID: \"c5ca0e97-8159-4564-af2a-133d8cc0ab88\") " pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:15:08.365657 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.365624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dl7c2"
Jul 29 01:15:08.536725 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.536695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dl7c2"]
Jul 29 01:15:08.539996 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:08.539966    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ca0e97_8159_4564_af2a_133d8cc0ab88.slice/crio-4ccfc5ef37dc39b881e65477bcdb2e950f1943144a9a168c0ba0e0357dfc4373 WatchSource:0}: Error finding container 4ccfc5ef37dc39b881e65477bcdb2e950f1943144a9a168c0ba0e0357dfc4373: Status 404 returned error can't find the container with id 4ccfc5ef37dc39b881e65477bcdb2e950f1943144a9a168c0ba0e0357dfc4373
Jul 29 01:15:08.930421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.930383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:08.967617 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.967569    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ljzld"]
Jul 29 01:15:08.997298 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.997267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ljzld"]
Jul 29 01:15:08.997449 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.997363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:08.999833 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:08.999813    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:15:09.000177 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.000156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 01:15:09.000177 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.000173    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:15:09.000775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.000758    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l59kk\""
Jul 29 01:15:09.000881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.000803    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 01:15:09.000881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.000811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:15:09.018675 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.018644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:09.061936 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.061892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.062098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.061985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.062098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.062084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648ce93c-820a-4a75-9243-e43b90437759-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.062195 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.062125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdth\" (UniqueName: \"kubernetes.io/projected/648ce93c-820a-4a75-9243-e43b90437759-kube-api-access-htdth\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.084985 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.084952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:09.163047 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.163001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.163516 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.163055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.163516 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.163117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648ce93c-820a-4a75-9243-e43b90437759-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.163516 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.163164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdth\" (UniqueName: \"kubernetes.io/projected/648ce93c-820a-4a75-9243-e43b90437759-kube-api-access-htdth\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.164299 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.164250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648ce93c-820a-4a75-9243-e43b90437759-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.166816 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.166768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.166937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.166912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648ce93c-820a-4a75-9243-e43b90437759-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.172915 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.172886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdth\" (UniqueName: \"kubernetes.io/projected/648ce93c-820a-4a75-9243-e43b90437759-kube-api-access-htdth\") pod \"prometheus-operator-84d69f794d-ljzld\" (UID: \"648ce93c-820a-4a75-9243-e43b90437759\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.307171 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.307131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld"
Jul 29 01:15:09.384976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.384940    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5j2zt"
Jul 29 01:15:09.419447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.419410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dl7c2" event={"ID":"c5ca0e97-8159-4564-af2a-133d8cc0ab88","Type":"ContainerStarted","Data":"4ccfc5ef37dc39b881e65477bcdb2e950f1943144a9a168c0ba0e0357dfc4373"}
Jul 29 01:15:09.500995 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:09.500447    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ljzld"]
Jul 29 01:15:10.316938 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:10.316912    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:15:10.424872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:10.424821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld" event={"ID":"648ce93c-820a-4a75-9243-e43b90437759","Type":"ContainerStarted","Data":"ef22a8b4492b97987d54019f53897dc0bb20b331eae4fd189b079d67c34fce11"}
Jul 29 01:15:12.811628 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:12.811591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:13.784374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:13.784354    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:15:14.166458 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:14.166424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:14.442378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:14.442288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dl7c2" event={"ID":"c5ca0e97-8159-4564-af2a-133d8cc0ab88","Type":"ContainerStarted","Data":"5784db7e2a4a005b179ef767354c2c47060e9882639474eb43279e4f2ee69622"}
Jul 29 01:15:14.444846 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:14.444815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld" event={"ID":"648ce93c-820a-4a75-9243-e43b90437759","Type":"ContainerStarted","Data":"60f6d1e1903fcc9d1fc96e95297744a7ca918d8f182bb405d7b71dda14001d42"}
Jul 29 01:15:14.444991 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:14.444874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld" event={"ID":"648ce93c-820a-4a75-9243-e43b90437759","Type":"ContainerStarted","Data":"e2083a47192c82d10dce33faa2c80b0fcf769749f6474165fab79334207e3ad5"}
Jul 29 01:15:14.461269 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:14.461199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-ljzld" podStartSLOduration=2.319506056 podStartE2EDuration="6.461179035s" totalImagesPullingTime="4.141672979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:14.460468814 +0000 UTC m=+304.489709727" watchObservedRunningTime="2026-07-29 01:15:14.461179035 +0000 UTC m=+304.490419927"
Jul 29 01:15:15.666453 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:15.666395    2578 patch_prober.go:28] interesting pod/image-registry-b49f8796c-4n9lr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:15:15.666924 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:15.666481    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:15:16.099899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.099863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:16.315328 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.315222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:16.422513 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.422434    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5mql7"]
Jul 29 01:15:16.425856 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.425832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.427953 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.427926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:15:16.428212 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.428118    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:15:16.428308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.428246    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pnbbx\""
Jul 29 01:15:16.428934 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.428913    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:15:16.453498 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.453468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:16.464525 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.464497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:15:16.532903 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.532870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-metrics-client-ca\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.532914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-wtmp\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.532972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-sys\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-textfile\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2r9p\" (UniqueName: \"kubernetes.io/projected/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-kube-api-access-p2r9p\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.533320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.533270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-root\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634133 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634133 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2r9p\" (UniqueName: \"kubernetes.io/projected/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-kube-api-access-p2r9p\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634375 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:15:16.634260    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 01:15:16.634375 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-root\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634375 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-root\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634375 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:15:16.634330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls podName:4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:17.134307217 +0000 UTC m=+307.163548112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls") pod "node-exporter-5mql7" (UID: "4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9") : secret "node-exporter-tls" not found
Jul 29 01:15:16.634592 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-metrics-client-ca\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634592 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-wtmp\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634592 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-sys\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-textfile\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-wtmp\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.634932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.634741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-sys\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.635109 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.635069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-textfile\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.635251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.635120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-metrics-client-ca\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.635251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.635213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.637457 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.637436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.646093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.646067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2r9p\" (UniqueName: \"kubernetes.io/projected/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-kube-api-access-p2r9p\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:16.701350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.701281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:16.844439 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.844406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:16.955774 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:16.955686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:17.077725 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.077683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:17.139010 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.138972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:17.141449 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.141431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9-node-exporter-tls\") pod \"node-exporter-5mql7\" (UID: \"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9\") " pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:17.329304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.329257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:17.336197 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.336176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5mql7"
Jul 29 01:15:17.347103 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:17.347078    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3551ef_ef6f_45be_9f0f_f3245b5d1ed9.slice/crio-e36042bd54eb729842bd47ee7dedb2789b2a16643b44f82049d53d1eff33e30d WatchSource:0}: Error finding container e36042bd54eb729842bd47ee7dedb2789b2a16643b44f82049d53d1eff33e30d: Status 404 returned error can't find the container with id e36042bd54eb729842bd47ee7dedb2789b2a16643b44f82049d53d1eff33e30d
Jul 29 01:15:17.377814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.377781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:15:17.427405 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.427336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:17.457276 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.457238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dl7c2" event={"ID":"c5ca0e97-8159-4564-af2a-133d8cc0ab88","Type":"ContainerStarted","Data":"767c489292c3cd214e8cf5e164933940acbee6a8354893b96a34de0e0498f944"}
Jul 29 01:15:17.458587 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.458511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5mql7" event={"ID":"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9","Type":"ContainerStarted","Data":"e36042bd54eb729842bd47ee7dedb2789b2a16643b44f82049d53d1eff33e30d"}
Jul 29 01:15:17.532639 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.532605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:17.631678 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:17.631644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:18.475010 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:18.474980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5mql7" event={"ID":"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9","Type":"ContainerStarted","Data":"91684584591db10de2763f83a1bbdfacebf31e252f561f7af1ad2c3c8eb0fe4e"}
Jul 29 01:15:18.546735 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:18.546704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:18.647267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:18.647150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.311834 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.311756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.410348 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.410308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.470630 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.470599    2578 generic.go:356] "Generic (PLEG): container finished" podID="4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9" containerID="91684584591db10de2763f83a1bbdfacebf31e252f561f7af1ad2c3c8eb0fe4e" exitCode=0
Jul 29 01:15:19.470811 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.470685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5mql7" event={"ID":"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9","Type":"ContainerDied","Data":"91684584591db10de2763f83a1bbdfacebf31e252f561f7af1ad2c3c8eb0fe4e"}
Jul 29 01:15:19.579773 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.579701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.992715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:19.992613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:20.734076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.734040    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f84d6698-fg5tr"]
Jul 29 01:15:20.763391 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.763357    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f84d6698-fg5tr"]
Jul 29 01:15:20.763537 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.763473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.765655 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.765629    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 01:15:20.765801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.765767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 01:15:20.766595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.766554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cflkdo1005gpo\""
Jul 29 01:15:20.766709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.766606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 01:15:20.766709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.766654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dcc8z\""
Jul 29 01:15:20.766709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.766692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 01:15:20.871569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-tls\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871707 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-audit-log\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871707 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-client-certs\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871707 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-client-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-metrics-server-audit-profiles\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.871906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.871786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqzcq\" (UniqueName: \"kubernetes.io/projected/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-kube-api-access-kqzcq\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972617 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-client-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972617 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-metrics-server-audit-profiles\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqzcq\" (UniqueName: \"kubernetes.io/projected/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-kube-api-access-kqzcq\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-tls\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-audit-log\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-client-certs\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.972872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.972784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.973310 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.973189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-audit-log\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.973507 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.973442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.973729 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.973710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-metrics-server-audit-profiles\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.975392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.975370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-tls\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.975491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.975403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-secret-metrics-server-client-certs\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.975491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.975411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-client-ca-bundle\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:20.981111 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:20.981089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqzcq\" (UniqueName: \"kubernetes.io/projected/7dd1caf1-45d6-4ac2-ba40-a38569c472e6-kube-api-access-kqzcq\") pod \"metrics-server-5f84d6698-fg5tr\" (UID: \"7dd1caf1-45d6-4ac2-ba40-a38569c472e6\") " pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:21.072937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.072900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:21.080187 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.080163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:21.212927 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.212740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f84d6698-fg5tr"]
Jul 29 01:15:21.215467 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:21.215438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd1caf1_45d6_4ac2_ba40_a38569c472e6.slice/crio-b292ff811a231272bbdba31e8d8ca6b916ac5c6170c41bcca9aa4ca7ab681d6f WatchSource:0}: Error finding container b292ff811a231272bbdba31e8d8ca6b916ac5c6170c41bcca9aa4ca7ab681d6f: Status 404 returned error can't find the container with id b292ff811a231272bbdba31e8d8ca6b916ac5c6170c41bcca9aa4ca7ab681d6f
Jul 29 01:15:21.250930 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.250901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:21.480824 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.480734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dl7c2" event={"ID":"c5ca0e97-8159-4564-af2a-133d8cc0ab88","Type":"ContainerStarted","Data":"1973e3369788d902c657623cc8e3057aceeb4136a661251222dbf22a203385af"}
Jul 29 01:15:21.482844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.482820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5mql7" event={"ID":"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9","Type":"ContainerStarted","Data":"6d204afc00ece5ca73b90dde44de206e3d03bbcd85bf8c4692b74f7124f3bf3d"}
Jul 29 01:15:21.482963 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.482871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5mql7" event={"ID":"4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9","Type":"ContainerStarted","Data":"271c147caa8a2f3bb11d258ebd846b143a3f21d3e6c4ed9ead3af948e3c989b9"}
Jul 29 01:15:21.483985 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.483965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr" event={"ID":"7dd1caf1-45d6-4ac2-ba40-a38569c472e6","Type":"ContainerStarted","Data":"b292ff811a231272bbdba31e8d8ca6b916ac5c6170c41bcca9aa4ca7ab681d6f"}
Jul 29 01:15:21.498713 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.498670    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dl7c2" podStartSLOduration=33.324936803 podStartE2EDuration="45.498650314s" totalImagesPullingTime="12.173713511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:14:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:21.497308618 +0000 UTC m=+311.526549523" watchObservedRunningTime="2026-07-29 01:15:21.498650314 +0000 UTC m=+311.527891245"
Jul 29 01:15:21.521034 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.520978    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5mql7" podStartSLOduration=4.420995737 podStartE2EDuration="5.52096266s" totalImagesPullingTime="1.016716415s" totalInitContainerRuntime="83.250508ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:21.51966786 +0000 UTC m=+311.548908770" watchObservedRunningTime="2026-07-29 01:15:21.52096266 +0000 UTC m=+311.550203571"
Jul 29 01:15:21.900106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:21.900078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:22.004488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:22.004458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:22.578295 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:22.578249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:23.493778 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:23.493732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr" event={"ID":"7dd1caf1-45d6-4ac2-ba40-a38569c472e6","Type":"ContainerStarted","Data":"910d68cb6046ec5c26a2d39473e76c920b8e03bce0e58ce616636666fc2aeafd"}
Jul 29 01:15:23.512167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:23.512118    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr" podStartSLOduration=1.9719199139999999 podStartE2EDuration="3.512099903s" totalImagesPullingTime="1.540179989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:23.511497189 +0000 UTC m=+313.540738125" watchObservedRunningTime="2026-07-29 01:15:23.512099903 +0000 UTC m=+313.541340893"
Jul 29 01:15:24.851974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:24.851934    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:15:24.938365 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:24.938332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:25.039739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:25.039709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.148024 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.147996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.243438 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.243398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.309404 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.309372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.608385 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.608354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.665207 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.665182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.806588 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.806539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.907276 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.907191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:29.993760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:29.993726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.058304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:31.058267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.205367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:31.205312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.477861 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:31.477771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.833905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:31.833875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.892075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:31.892040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:34.776736 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:34.776703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:34.833719 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:34.833688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:35.120877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:35.120796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:35.174729 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:35.174704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:38.008826 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:38.008793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:38.110149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:38.110120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:39.038926 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.038893    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:15:39.045863 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.045841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.048027 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.048000    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:15:39.048154 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.048000    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:15:39.048953 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.048936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:15:39.049102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.049081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:15:39.049102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.049086    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:15:39.049257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.049120    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:15:39.049257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.049177    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:15:39.049378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.049366    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kv859\""
Jul 29 01:15:39.054751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.054723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:15:39.126893 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.126857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.126893 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.126893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.127137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.126914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlth9\" (UniqueName: \"kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.127137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.127008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.127137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.127057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.127137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.127093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.227894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.227894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.227986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlth9\" (UniqueName: \"kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.228656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.228710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.228708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.228737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.230549 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.230523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.230666 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.230526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.236297 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.236260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlth9\" (UniqueName: \"kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9\") pod \"console-7db84769c5-dlcpz\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") " pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.355596 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.355496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:39.486594 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.486544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:15:39.490203 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:39.490175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc95e3e3_42ec_4d8a_9234_29f91ca6554b.slice/crio-287395027d675a148a7e48098dac6b6927d67b75793b8632ec52571cc000088f WatchSource:0}: Error finding container 287395027d675a148a7e48098dac6b6927d67b75793b8632ec52571cc000088f: Status 404 returned error can't find the container with id 287395027d675a148a7e48098dac6b6927d67b75793b8632ec52571cc000088f
Jul 29 01:15:39.551836 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:39.551804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db84769c5-dlcpz" event={"ID":"dc95e3e3-42ec-4d8a-9234-29f91ca6554b","Type":"ContainerStarted","Data":"287395027d675a148a7e48098dac6b6927d67b75793b8632ec52571cc000088f"}
Jul 29 01:15:41.073431 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:41.073391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:41.073935 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:41.073463    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:15:42.564954 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:42.564875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db84769c5-dlcpz" event={"ID":"dc95e3e3-42ec-4d8a-9234-29f91ca6554b","Type":"ContainerStarted","Data":"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"}
Jul 29 01:15:42.582614 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:42.582541    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db84769c5-dlcpz" podStartSLOduration=0.766414951 podStartE2EDuration="3.582526155s" totalImagesPullingTime="2.816111204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:42.581298997 +0000 UTC m=+332.610539904" watchObservedRunningTime="2026-07-29 01:15:42.582526155 +0000 UTC m=+332.611767071"
Jul 29 01:15:44.424293 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:44.424259    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:44.481421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:44.481388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:46.585731 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:46.585695    2578 generic.go:356] "Generic (PLEG): container finished" podID="2b269050-1777-4a66-be63-59aa402f9c94" containerID="cda5a956151d771c0697f38a5cf274b54f8146d30b3ff2ac8bb27524ad6fcc9a" exitCode=0
Jul 29 01:15:46.586167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:46.585772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm" event={"ID":"2b269050-1777-4a66-be63-59aa402f9c94","Type":"ContainerDied","Data":"cda5a956151d771c0697f38a5cf274b54f8146d30b3ff2ac8bb27524ad6fcc9a"}
Jul 29 01:15:46.586167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:46.586101    2578 scope.go:117] "RemoveContainer" containerID="cda5a956151d771c0697f38a5cf274b54f8146d30b3ff2ac8bb27524ad6fcc9a"
Jul 29 01:15:47.590718 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.590683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-65wpm" event={"ID":"2b269050-1777-4a66-be63-59aa402f9c94","Type":"ContainerStarted","Data":"0e0535c6cf1055c9f1e6f925162df58627d4df118e4200b5d58bd3ee43069432"}
Jul 29 01:15:47.822051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.822016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:15:47.825282 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.825266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.832177 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.832015    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 01:15:47.835415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.835393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:15:47.898463 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898463 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.898690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.898660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jr8k\" (UniqueName: \"kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jr8k\" (UniqueName: \"kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:47.999751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:47.999644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.000273 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.000241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.000460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.000387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.000548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.000487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.000548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.000502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.002607 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.002565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.002698 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.002674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.007616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.007594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jr8k\" (UniqueName: \"kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k\") pod \"console-958765459-zr7jw\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") " pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.134265 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.134230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:48.264547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.264440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:15:48.267072 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:15:48.267038    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f2915e_5199_4da2_a27d_4ae35a9f0c85.slice/crio-4631c1292753b8652c9ac7579b72e25a36a2ebcfd8374cadb8948ee7c95c0194 WatchSource:0}: Error finding container 4631c1292753b8652c9ac7579b72e25a36a2ebcfd8374cadb8948ee7c95c0194: Status 404 returned error can't find the container with id 4631c1292753b8652c9ac7579b72e25a36a2ebcfd8374cadb8948ee7c95c0194
Jul 29 01:15:48.595590 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.595532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-958765459-zr7jw" event={"ID":"d0f2915e-5199-4da2-a27d-4ae35a9f0c85","Type":"ContainerStarted","Data":"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"}
Jul 29 01:15:48.595937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.595622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-958765459-zr7jw" event={"ID":"d0f2915e-5199-4da2-a27d-4ae35a9f0c85","Type":"ContainerStarted","Data":"4631c1292753b8652c9ac7579b72e25a36a2ebcfd8374cadb8948ee7c95c0194"}
Jul 29 01:15:48.611554 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.611500    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-958765459-zr7jw" podStartSLOduration=1.611480873 podStartE2EDuration="1.611480873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:48.611002251 +0000 UTC m=+338.640243163" watchObservedRunningTime="2026-07-29 01:15:48.611480873 +0000 UTC m=+338.640721788"
Jul 29 01:15:48.636302 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.636263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:48.696335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:48.696302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:49.356415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.356377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:49.356656 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.356436    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:49.360956 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.360932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:49.602446 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.602419    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:15:49.783392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.783358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:49.834975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.834935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:49.876098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:49.876062    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerName="registry" containerID="cri-o://1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b" gracePeriod=30
Jul 29 01:15:50.124234 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.124214    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:15:50.218624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218730    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjmj\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.218830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.219132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.218838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates\") pod \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\" (UID: \"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5\") "
Jul 29 01:15:50.219336 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.219282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:50.219469 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.219417    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:50.221433 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.221388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:50.221556 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.221491    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:50.221637 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.221605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj" (OuterVolumeSpecName: "kube-api-access-7jjmj") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "kube-api-access-7jjmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:50.221696 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.221675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:50.221755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.221721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:50.227340 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.227318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" (UID: "1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320060    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-certificates\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320087    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-ca-trust-extracted\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320098    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-bound-sa-token\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320107    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-image-registry-private-configuration\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320115    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-installation-pull-secrets\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320122    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-trusted-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320131    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjmj\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-kube-api-access-7jjmj\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.320135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.320139    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5-registry-tls\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:15:50.604167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.604095    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerID="1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b" exitCode=0
Jul 29 01:15:50.604167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.604144    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr"
Jul 29 01:15:50.604635 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.604177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" event={"ID":"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5","Type":"ContainerDied","Data":"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"}
Jul 29 01:15:50.604635 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.604230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b49f8796c-4n9lr" event={"ID":"1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5","Type":"ContainerDied","Data":"b23b54323e548847aec0dfa90e7da07f17258c18d3acf6b4b9fa57ba74d093ac"}
Jul 29 01:15:50.604635 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.604251    2578 scope.go:117] "RemoveContainer" containerID="1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"
Jul 29 01:15:50.613296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.613280    2578 scope.go:117] "RemoveContainer" containerID="1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"
Jul 29 01:15:50.613618 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:15:50.613570    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b\": container with ID starting with 1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b not found: ID does not exist" containerID="1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"
Jul 29 01:15:50.613708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.613624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b"} err="failed to get container status \"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b\": rpc error: code = NotFound desc = could not find container \"1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b\": container with ID starting with 1614adcaab891c4d915a36522cb504dd1b38ede2f00b989ee4fdf7bc66b34b2b not found: ID does not exist"
Jul 29 01:15:50.620341 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.620320    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:15:50.626422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:50.626401    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b49f8796c-4n9lr"]
Jul 29 01:15:52.473427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:52.473355    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" path="/var/lib/kubelet/pods/1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5/volumes"
Jul 29 01:15:54.625691 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:54.625627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:54.681980 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:54.681948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:55.627169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:55.627139    2578 generic.go:356] "Generic (PLEG): container finished" podID="1e5cc00a-5347-4c46-9017-8f0c1fb5e593" containerID="53e96eecef6d48f8f758e3c4ca877e52265cad368b7318f107823e1e120ffa39" exitCode=0
Jul 29 01:15:55.627489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:55.627218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8v9jv" event={"ID":"1e5cc00a-5347-4c46-9017-8f0c1fb5e593","Type":"ContainerDied","Data":"53e96eecef6d48f8f758e3c4ca877e52265cad368b7318f107823e1e120ffa39"}
Jul 29 01:15:55.627552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:55.627540    2578 scope.go:117] "RemoveContainer" containerID="53e96eecef6d48f8f758e3c4ca877e52265cad368b7318f107823e1e120ffa39"
Jul 29 01:15:56.093743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.093715    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88848ff99-95vmc_4d6270cf-5a84-4767-8299-da274feb9c8a/router/0.log"
Jul 29 01:15:56.099550 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.099528    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9ptcc_2bc4543b-3ba8-4273-95e8-a258faa03958/serve-healthcheck-canary/0.log"
Jul 29 01:15:56.632558 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.632523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8v9jv" event={"ID":"1e5cc00a-5347-4c46-9017-8f0c1fb5e593","Type":"ContainerStarted","Data":"9a6d53b05ea27e1737b3256db9fa550f228dce543fd08e405d3adc84c09f0b46"}
Jul 29 01:15:56.703550 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.703498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:56.802389 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.802349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:56.857004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:56.856957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:58.135253 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:58.135220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:58.135692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:58.135304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:58.140124 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:58.140101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:58.643192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:58.643156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:15:58.689750 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:58.689712    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:15:59.255050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:59.255021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:59.335606 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:15:59.335531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:00.648003 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:00.647968    2578 generic.go:356] "Generic (PLEG): container finished" podID="965e3f45-1d4a-428e-9126-b031fb1ba11f" containerID="c3959fc938b42b8e2e4be33e0aebd19fb09b55ce22438f47c637b84d0e56c824" exitCode=0
Jul 29 01:16:00.648461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:00.648048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg" event={"ID":"965e3f45-1d4a-428e-9126-b031fb1ba11f","Type":"ContainerDied","Data":"c3959fc938b42b8e2e4be33e0aebd19fb09b55ce22438f47c637b84d0e56c824"}
Jul 29 01:16:00.648531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:00.648472    2578 scope.go:117] "RemoveContainer" containerID="c3959fc938b42b8e2e4be33e0aebd19fb09b55ce22438f47c637b84d0e56c824"
Jul 29 01:16:01.080486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:01.080454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:16:01.084311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:01.084287    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f84d6698-fg5tr"
Jul 29 01:16:01.653617 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:01.653555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lr5lg" event={"ID":"965e3f45-1d4a-428e-9126-b031fb1ba11f","Type":"ContainerStarted","Data":"c60cedd60a6e5737b55d57f1047e1c4371a91ff53b86eb8e300eee46222df344"}
Jul 29 01:16:04.781179 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:04.781149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:04.837181 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:04.837151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:23.714031 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:23.713985    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7db84769c5-dlcpz" podUID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" containerName="console" containerID="cri-o://48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8" gracePeriod=15
Jul 29 01:16:23.957085 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:23.957057    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:16:24.108818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108908    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.108955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlth9\" (UniqueName: \"kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9\") pod \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\" (UID: \"dc95e3e3-42ec-4d8a-9234-29f91ca6554b\") "
Jul 29 01:16:24.109296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.109275    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:24.109354 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.109284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config" (OuterVolumeSpecName: "console-config") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:24.109392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.109350    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:24.111422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.111392    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:24.111528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.111441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:24.111528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.111468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9" (OuterVolumeSpecName: "kube-api-access-wlth9") pod "dc95e3e3-42ec-4d8a-9234-29f91ca6554b" (UID: "dc95e3e3-42ec-4d8a-9234-29f91ca6554b"). InnerVolumeSpecName "kube-api-access-wlth9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:24.209779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209736    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.209779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209772    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-oauth-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.209779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209782    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-console-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.209779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209791    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlth9\" (UniqueName: \"kubernetes.io/projected/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-kube-api-access-wlth9\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.210034 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209800    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-oauth-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.210034 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.209808    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc95e3e3-42ec-4d8a-9234-29f91ca6554b-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:16:24.310790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.310749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:16:24.313161 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.313132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9051c65-4011-4559-9ac5-9f8bdf5e6bee-metrics-certs\") pod \"network-metrics-daemon-hxcqh\" (UID: \"f9051c65-4011-4559-9ac5-9f8bdf5e6bee\") " pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:16:24.567983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.567948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llbnf\""
Jul 29 01:16:24.576625 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.576605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxcqh"
Jul 29 01:16:24.706839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.706812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hxcqh"]
Jul 29 01:16:24.709771 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:16:24.709744    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9051c65_4011_4559_9ac5_9f8bdf5e6bee.slice/crio-97d2940cb06bee6873bb4836eecde1f24588563b6e1996f8a49d718ede8d8833 WatchSource:0}: Error finding container 97d2940cb06bee6873bb4836eecde1f24588563b6e1996f8a49d718ede8d8833: Status 404 returned error can't find the container with id 97d2940cb06bee6873bb4836eecde1f24588563b6e1996f8a49d718ede8d8833
Jul 29 01:16:24.739894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.739825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxcqh" event={"ID":"f9051c65-4011-4559-9ac5-9f8bdf5e6bee","Type":"ContainerStarted","Data":"97d2940cb06bee6873bb4836eecde1f24588563b6e1996f8a49d718ede8d8833"}
Jul 29 01:16:24.741013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.740987    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" containerID="48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8" exitCode=0
Jul 29 01:16:24.741107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.741022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db84769c5-dlcpz" event={"ID":"dc95e3e3-42ec-4d8a-9234-29f91ca6554b","Type":"ContainerDied","Data":"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"}
Jul 29 01:16:24.741107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.741036    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db84769c5-dlcpz"
Jul 29 01:16:24.741107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.741050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db84769c5-dlcpz" event={"ID":"dc95e3e3-42ec-4d8a-9234-29f91ca6554b","Type":"ContainerDied","Data":"287395027d675a148a7e48098dac6b6927d67b75793b8632ec52571cc000088f"}
Jul 29 01:16:24.741107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.741069    2578 scope.go:117] "RemoveContainer" containerID="48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"
Jul 29 01:16:24.752134 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.752111    2578 scope.go:117] "RemoveContainer" containerID="48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"
Jul 29 01:16:24.752409 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:16:24.752392    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8\": container with ID starting with 48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8 not found: ID does not exist" containerID="48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"
Jul 29 01:16:24.752453 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.752416    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8"} err="failed to get container status \"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8\": rpc error: code = NotFound desc = could not find container \"48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8\": container with ID starting with 48976b84f38b908567ebd633d61e167d7b391455b8d655adcb25797fd2b7caf8 not found: ID does not exist"
Jul 29 01:16:24.757246 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.757224    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:16:24.759376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:24.759354    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db84769c5-dlcpz"]
Jul 29 01:16:25.747301 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:25.747261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxcqh" event={"ID":"f9051c65-4011-4559-9ac5-9f8bdf5e6bee","Type":"ContainerStarted","Data":"d7bc53759f6b18c8638544066ae1692159d03a86fdc2b702f50c4ebdf9fc8700"}
Jul 29 01:16:25.747752 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:25.747366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxcqh" event={"ID":"f9051c65-4011-4559-9ac5-9f8bdf5e6bee","Type":"ContainerStarted","Data":"82dadfb774935e7d5a11db2d2b4cc53739910b47315de2e87df12cc743e21d6c"}
Jul 29 01:16:25.763392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:25.763340    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hxcqh" podStartSLOduration=374.956207595 podStartE2EDuration="6m15.763322973s" totalImagesPullingTime="807.115378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:25.761833914 +0000 UTC m=+375.791074827" watchObservedRunningTime="2026-07-29 01:16:25.763322973 +0000 UTC m=+375.792563890"
Jul 29 01:16:25.846162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:25.846086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:25.946456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:25.946424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:26.469414 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:26.469382    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" path="/var/lib/kubelet/pods/dc95e3e3-42ec-4d8a-9234-29f91ca6554b/volumes"
Jul 29 01:16:28.958035 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:28.958004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:29.016866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:29.016830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:35.608973 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:35.608929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:35.810440 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:35.810402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:39.335153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:39.335114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:39.442157 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:39.442122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:44.636134 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636100    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" containerName="console"
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636415    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" containerName="console"
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636433    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerName="registry"
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636439    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerName="registry"
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636483    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ccb72b4-7334-4ee7-bcdd-bb6b4a2125a5" containerName="registry"
Jul 29 01:16:44.636519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.636490    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc95e3e3-42ec-4d8a-9234-29f91ca6554b" containerName="console"
Jul 29 01:16:44.642127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.642099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2p6d\" (UniqueName: \"kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.659716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.659650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.681635 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.681601    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:16:44.743404 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.743364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:44.760990 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.760955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2p6d\" (UniqueName: \"kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.761186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.762026 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.762026 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.761999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.762443 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.762414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.762562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.762541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.763874 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.763856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.763983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.763962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.770168 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.770142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2p6d\" (UniqueName: \"kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d\") pod \"console-677ccf49dd-8pbf4\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") " pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:44.804109 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.804074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:44.952107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:44.951998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:45.108375 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:45.108295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:16:45.114407 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:16:45.114378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ab5fdd_8cc2_4374_a8b3_ead4906d6c69.slice/crio-c3ed3398d625ae875e59801e58f09c6d87ac1905cd7bc973db7900d2daafc4b6 WatchSource:0}: Error finding container c3ed3398d625ae875e59801e58f09c6d87ac1905cd7bc973db7900d2daafc4b6: Status 404 returned error can't find the container with id c3ed3398d625ae875e59801e58f09c6d87ac1905cd7bc973db7900d2daafc4b6
Jul 29 01:16:45.826521 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:45.826482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ccf49dd-8pbf4" event={"ID":"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69","Type":"ContainerStarted","Data":"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"}
Jul 29 01:16:45.826954 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:45.826542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ccf49dd-8pbf4" event={"ID":"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69","Type":"ContainerStarted","Data":"c3ed3398d625ae875e59801e58f09c6d87ac1905cd7bc973db7900d2daafc4b6"}
Jul 29 01:16:45.844993 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:45.844941    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677ccf49dd-8pbf4" podStartSLOduration=1.844923358 podStartE2EDuration="1.844923358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:45.843925692 +0000 UTC m=+395.873166606" watchObservedRunningTime="2026-07-29 01:16:45.844923358 +0000 UTC m=+395.874164271"
Jul 29 01:16:54.953045 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:54.953010    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:54.953683 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:54.953073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:54.957908 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:54.957884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:55.866910 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:55.866880    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:16:55.915516 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:55.915483    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:16:56.020730 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:56.020698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:56.120367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:56.120247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:56.178978 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:16:56.178947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:20.939378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:20.939319    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-958765459-zr7jw" podUID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" containerName="console" containerID="cri-o://5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee" gracePeriod=15
Jul 29 01:17:21.186613 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.186569    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:17:21.255360 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255331    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255427    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jr8k\" (UniqueName: \"kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255515    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle\") pod \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\" (UID: \"d0f2915e-5199-4da2-a27d-4ae35a9f0c85\") "
Jul 29 01:17:21.255906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:17:21.255976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:17:21.255976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.255954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config" (OuterVolumeSpecName: "console-config") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:17:21.256053 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.256003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:17:21.257659 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.257637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:17:21.258269 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.258247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:17:21.258269 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.258258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k" (OuterVolumeSpecName: "kube-api-access-2jr8k") pod "d0f2915e-5199-4da2-a27d-4ae35a9f0c85" (UID: "d0f2915e-5199-4da2-a27d-4ae35a9f0c85"). InnerVolumeSpecName "kube-api-access-2jr8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:17:21.356491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356457    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356481    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356490    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-oauth-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356499    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jr8k\" (UniqueName: \"kubernetes.io/projected/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-kube-api-access-2jr8k\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356753 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356507    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-console-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356753 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356516    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-oauth-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.356753 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.356524    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f2915e-5199-4da2-a27d-4ae35a9f0c85-trusted-ca-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:17:21.964222 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.964189    2578 generic.go:356] "Generic (PLEG): container finished" podID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" containerID="5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee" exitCode=0
Jul 29 01:17:21.964615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.964232    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-958765459-zr7jw"
Jul 29 01:17:21.964615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.964279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-958765459-zr7jw" event={"ID":"d0f2915e-5199-4da2-a27d-4ae35a9f0c85","Type":"ContainerDied","Data":"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"}
Jul 29 01:17:21.964615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.964329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-958765459-zr7jw" event={"ID":"d0f2915e-5199-4da2-a27d-4ae35a9f0c85","Type":"ContainerDied","Data":"4631c1292753b8652c9ac7579b72e25a36a2ebcfd8374cadb8948ee7c95c0194"}
Jul 29 01:17:21.964615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.964350    2578 scope.go:117] "RemoveContainer" containerID="5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"
Jul 29 01:17:21.973072 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.973054    2578 scope.go:117] "RemoveContainer" containerID="5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"
Jul 29 01:17:21.973308 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:17:21.973292    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee\": container with ID starting with 5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee not found: ID does not exist" containerID="5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"
Jul 29 01:17:21.973352 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.973316    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee"} err="failed to get container status \"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee\": rpc error: code = NotFound desc = could not find container \"5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee\": container with ID starting with 5fd39065bcf06dcbcba382d40d0c739a0dd29bf8ad851f06e568321a004bdcee not found: ID does not exist"
Jul 29 01:17:21.983490 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.983463    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:17:21.988016 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:21.987996    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-958765459-zr7jw"]
Jul 29 01:17:22.469012 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:22.468981    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" path="/var/lib/kubelet/pods/d0f2915e-5199-4da2-a27d-4ae35a9f0c85/volumes"
Jul 29 01:17:26.177607 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:26.177546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.241790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:26.241759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:50.866207 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:50.866173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:50.922051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:50.922016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:56.064287 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:56.064254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.495634 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.495601    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:17:59.496116 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.495927    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" containerName="console"
Jul 29 01:17:59.496116 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.495939    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" containerName="console"
Jul 29 01:17:59.496116 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.495990    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f2915e-5199-4da2-a27d-4ae35a9f0c85" containerName="console"
Jul 29 01:17:59.499005 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.498986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.510775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.510748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:17:59.554451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.554402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.555434 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.555804 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.555680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr259\" (UniqueName: \"kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.620304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.620258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.656445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr259\" (UniqueName: \"kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656616 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.656894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.656638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.657239 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.657212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.657474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.657450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.657547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.657514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.657747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.657727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.659087 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.659066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.659169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.659118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.665379 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.665351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr259\" (UniqueName: \"kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259\") pod \"console-dd9cd9f7b-d4w4b\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") " pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.807731 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.807691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:17:59.956013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:17:59.955982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:17:59.959624 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:17:59.959590    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dd8f14_6495_41bb_bec3_3c185f3ca043.slice/crio-6920b2ee492c62b7a94bd1f40072ae2ebf0d342232728deedc7218981bd4594f WatchSource:0}: Error finding container 6920b2ee492c62b7a94bd1f40072ae2ebf0d342232728deedc7218981bd4594f: Status 404 returned error can't find the container with id 6920b2ee492c62b7a94bd1f40072ae2ebf0d342232728deedc7218981bd4594f
Jul 29 01:18:00.108562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:00.108469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9cd9f7b-d4w4b" event={"ID":"d7dd8f14-6495-41bb-bec3-3c185f3ca043","Type":"ContainerStarted","Data":"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"}
Jul 29 01:18:00.108562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:00.108514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9cd9f7b-d4w4b" event={"ID":"d7dd8f14-6495-41bb-bec3-3c185f3ca043","Type":"ContainerStarted","Data":"6920b2ee492c62b7a94bd1f40072ae2ebf0d342232728deedc7218981bd4594f"}
Jul 29 01:18:00.129048 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:00.129000    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd9cd9f7b-d4w4b" podStartSLOduration=1.1289832340000001 podStartE2EDuration="1.128983234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:18:00.128691393 +0000 UTC m=+470.157932307" watchObservedRunningTime="2026-07-29 01:18:00.128983234 +0000 UTC m=+470.158224147"
Jul 29 01:18:02.946062 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:02.946032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:03.002332 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:03.002274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:09.808173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:09.808131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:18:09.808682 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:09.808222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:18:09.812987 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:09.812964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:18:10.148863 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:10.148775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:18:10.194127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:10.194093    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:18:10.288272 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:10.288239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:10.388406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:10.388372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:10.489468 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:10.489382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:17.069979 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:17.069943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:17.172233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:17.172198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:35.215969 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.215920    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-677ccf49dd-8pbf4" podUID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" containerName="console" containerID="cri-o://3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9" gracePeriod=15
Jul 29 01:18:35.467633 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.467546    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:18:35.555279 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555279 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555346    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2p6d\" (UniqueName: \"kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d\") pod \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\" (UID: \"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69\") "
Jul 29 01:18:35.555842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config" (OuterVolumeSpecName: "console-config") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:18:35.555842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.555772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:18:35.556154 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.556132    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:18:35.556258 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.556198    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:18:35.557799 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.557777    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:18:35.557799 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.557791    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d" (OuterVolumeSpecName: "kube-api-access-x2p6d") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "kube-api-access-x2p6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:18:35.558208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.558188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" (UID: "d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:18:35.656547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656507    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656539    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-oauth-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656553    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656566    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-oauth-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656608    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-trusted-ca-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656620    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2p6d\" (UniqueName: \"kubernetes.io/projected/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-kube-api-access-x2p6d\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:35.656813 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:35.656631    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69-console-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:18:36.244690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.244653    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" containerID="3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9" exitCode=0
Jul 29 01:18:36.245176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.244701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ccf49dd-8pbf4" event={"ID":"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69","Type":"ContainerDied","Data":"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"}
Jul 29 01:18:36.245176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.244713    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ccf49dd-8pbf4"
Jul 29 01:18:36.245176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.244767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ccf49dd-8pbf4" event={"ID":"d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69","Type":"ContainerDied","Data":"c3ed3398d625ae875e59801e58f09c6d87ac1905cd7bc973db7900d2daafc4b6"}
Jul 29 01:18:36.245176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.244788    2578 scope.go:117] "RemoveContainer" containerID="3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"
Jul 29 01:18:36.254068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.254047    2578 scope.go:117] "RemoveContainer" containerID="3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"
Jul 29 01:18:36.254364 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:18:36.254345    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9\": container with ID starting with 3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9 not found: ID does not exist" containerID="3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"
Jul 29 01:18:36.254402 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.254375    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9"} err="failed to get container status \"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9\": rpc error: code = NotFound desc = could not find container \"3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9\": container with ID starting with 3b04421b8137028ce226a46146d97c71c1d45543c77bb06f8add81b65d450bc9 not found: ID does not exist"
Jul 29 01:18:36.265003 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.264969    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:18:36.268447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.268424    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677ccf49dd-8pbf4"]
Jul 29 01:18:36.469432 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:36.469395    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" path="/var/lib/kubelet/pods/d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69/volumes"
Jul 29 01:18:50.496508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:50.496470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:50.592790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:50.592753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:51.147324 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.147291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"]
Jul 29 01:18:51.147677 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.147660    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" containerName="console"
Jul 29 01:18:51.147762 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.147680    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" containerName="console"
Jul 29 01:18:51.147830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.147783    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ab5fdd-8cc2-4374-a8b3-ead4906d6c69" containerName="console"
Jul 29 01:18:51.152196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.152171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.154445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.154423    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:18:51.154567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.154469    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:18:51.155124 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.155110    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7r5r\""
Jul 29 01:18:51.159958 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.159933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"]
Jul 29 01:18:51.282771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.282729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsttk\" (UniqueName: \"kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.282946 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.282782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.282946 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.282845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.383288 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.383255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsttk\" (UniqueName: \"kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.383462 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.383304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.383462 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.383345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.383769 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.383748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.383858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.383796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.391226 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.391198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsttk\" (UniqueName: \"kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.462391 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.462302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:18:51.601548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:51.601493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"]
Jul 29 01:18:51.604046 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:18:51.604021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0a1cbe_a3cd_4aa6_89bd_603351bada29.slice/crio-177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4 WatchSource:0}: Error finding container 177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4: Status 404 returned error can't find the container with id 177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4
Jul 29 01:18:52.304993 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:52.304946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz" event={"ID":"4a0a1cbe-a3cd-4aa6-89bd-603351bada29","Type":"ContainerStarted","Data":"177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4"}
Jul 29 01:18:57.398359 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:57.398319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:59.337869 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:59.337832    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerID="e5607f60b3333c6899b02bd40bffbac8b5b98441873e215dc0d6da978c53cdd3" exitCode=0
Jul 29 01:18:59.338267 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:18:59.337935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz" event={"ID":"4a0a1cbe-a3cd-4aa6-89bd-603351bada29","Type":"ContainerDied","Data":"e5607f60b3333c6899b02bd40bffbac8b5b98441873e215dc0d6da978c53cdd3"}
Jul 29 01:19:02.353552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:02.353506    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerID="b53e839581098408c305060c3638196959dc7b823ae9d6568968479ec4875ac9" exitCode=0
Jul 29 01:19:02.353956 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:02.353618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz" event={"ID":"4a0a1cbe-a3cd-4aa6-89bd-603351bada29","Type":"ContainerDied","Data":"b53e839581098408c305060c3638196959dc7b823ae9d6568968479ec4875ac9"}
Jul 29 01:19:09.386611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:09.386554    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerID="1374e04eeeb85a9cb08ac6df53219ddd0612cc117e2db92674740b87082d78b0" exitCode=0
Jul 29 01:19:09.387041 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:09.386644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz" event={"ID":"4a0a1cbe-a3cd-4aa6-89bd-603351bada29","Type":"ContainerDied","Data":"1374e04eeeb85a9cb08ac6df53219ddd0612cc117e2db92674740b87082d78b0"}
Jul 29 01:19:10.521935 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.521907    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:19:10.541545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.541504    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsttk\" (UniqueName: \"kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk\") pod \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") "
Jul 29 01:19:10.541737 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.541561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util\") pod \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") "
Jul 29 01:19:10.541737 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.541616    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle\") pod \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\" (UID: \"4a0a1cbe-a3cd-4aa6-89bd-603351bada29\") "
Jul 29 01:19:10.542419 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.542388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle" (OuterVolumeSpecName: "bundle") pod "4a0a1cbe-a3cd-4aa6-89bd-603351bada29" (UID: "4a0a1cbe-a3cd-4aa6-89bd-603351bada29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:10.544017 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.543986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk" (OuterVolumeSpecName: "kube-api-access-vsttk") pod "4a0a1cbe-a3cd-4aa6-89bd-603351bada29" (UID: "4a0a1cbe-a3cd-4aa6-89bd-603351bada29"). InnerVolumeSpecName "kube-api-access-vsttk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:10.549540 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.549505    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util" (OuterVolumeSpecName: "util") pod "4a0a1cbe-a3cd-4aa6-89bd-603351bada29" (UID: "4a0a1cbe-a3cd-4aa6-89bd-603351bada29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:10.643001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.642913    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsttk\" (UniqueName: \"kubernetes.io/projected/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-kube-api-access-vsttk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:10.643001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.642945    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:10.643001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:10.642955    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a0a1cbe-a3cd-4aa6-89bd-603351bada29-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:11.395147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:11.395112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz" event={"ID":"4a0a1cbe-a3cd-4aa6-89bd-603351bada29","Type":"ContainerDied","Data":"177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4"}
Jul 29 01:19:11.395147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:11.395130    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjsbz"
Jul 29 01:19:11.395345 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:11.395160    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="177e84f1781439763b9de41ae743cf54e135955c74b58ba27116948b15dea6f4"
Jul 29 01:19:17.302296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:17.302266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:18.064743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:18.064710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:19.195164 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195128    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"]
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195385    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="pull"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195395    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="pull"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195404    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="extract"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195409    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="extract"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="util"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195434    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="util"
Jul 29 01:19:19.195528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.195480    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a0a1cbe-a3cd-4aa6-89bd-603351bada29" containerName="extract"
Jul 29 01:19:19.198886 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.198870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.201118 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.201099    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-sclqr\""
Jul 29 01:19:19.203424 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.203405    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 01:19:19.203539 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.203478    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:19:19.218524 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.218498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"]
Jul 29 01:19:19.311396 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.311358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45mr\" (UniqueName: \"kubernetes.io/projected/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-kube-api-access-j45mr\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.311570 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.311412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.412657 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.412620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45mr\" (UniqueName: \"kubernetes.io/projected/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-kube-api-access-j45mr\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.412870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.412680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.413050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.413033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.423199 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.423173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45mr\" (UniqueName: \"kubernetes.io/projected/6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225-kube-api-access-j45mr\") pod \"cert-manager-operator-controller-manager-55c444bf86-fqq6s\" (UID: \"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.507919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.507893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"
Jul 29 01:19:19.642123 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:19.641821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s"]
Jul 29 01:19:19.646827 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:19:19.646800    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8a80a5_0ce3_4c26_8f55_e1c1c9e81225.slice/crio-4825ac49046216ed8f7750438575fdb0c5fbc84dec184708ea22e357a70f5ebb WatchSource:0}: Error finding container 4825ac49046216ed8f7750438575fdb0c5fbc84dec184708ea22e357a70f5ebb: Status 404 returned error can't find the container with id 4825ac49046216ed8f7750438575fdb0c5fbc84dec184708ea22e357a70f5ebb
Jul 29 01:19:20.430093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:20.430061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s" event={"ID":"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225","Type":"ContainerStarted","Data":"4825ac49046216ed8f7750438575fdb0c5fbc84dec184708ea22e357a70f5ebb"}
Jul 29 01:19:21.038959 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:21.038923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:21.098949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:21.098898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:22.439981 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:22.439950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s" event={"ID":"6b8a80a5-0ce3-4c26-8f55-e1c1c9e81225","Type":"ContainerStarted","Data":"0bd3e0087cc5130f31dc0cf81aa8b60ab00180f5d632dd6750cbc3436bb75ec6"}
Jul 29 01:19:22.471159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:22.471106    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fqq6s" podStartSLOduration=1.671717957 podStartE2EDuration="3.471086904s" totalImagesPullingTime="1.799368947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:22.470017431 +0000 UTC m=+552.499258344" watchObservedRunningTime="2026-07-29 01:19:22.471086904 +0000 UTC m=+552.500327821"
Jul 29 01:19:22.831919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:22.831873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:22.948785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:22.948750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.012332 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.012291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"]
Jul 29 01:19:23.015624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.015608    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.018256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.018235    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:19:23.018405 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.018363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7r5r\""
Jul 29 01:19:23.020336 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.020316    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:19:23.030906 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.030876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"]
Jul 29 01:19:23.144121 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.144031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkdn\" (UniqueName: \"kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.144121 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.144069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.144309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.144137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.244701 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.244666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkdn\" (UniqueName: \"kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.244902 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.244706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.244902 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.244777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.245128 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.245105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.245196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.245149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.278805 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.278769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkdn\" (UniqueName: \"kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.307889 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.307845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.324212 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.324183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:23.482995 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.482970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"]
Jul 29 01:19:23.485430 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:19:23.485409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2eef921_f8b0_4d8a_9bbf_501539ead773.slice/crio-ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11 WatchSource:0}: Error finding container ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11: Status 404 returned error can't find the container with id ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11
Jul 29 01:19:23.521050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.521023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.692257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.692169    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-czt2z"]
Jul 29 01:19:23.695402 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.695380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.698760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.698740    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 01:19:23.698917 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.698784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vzzlh\""
Jul 29 01:19:23.699132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.699117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 01:19:23.708338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.708315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-czt2z"]
Jul 29 01:19:23.747988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.747959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.747988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.747989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-945tl\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-kube-api-access-945tl\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.849062 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.849031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.849062 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.849063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-945tl\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-kube-api-access-945tl\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.858090 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.858058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:23.858690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:23.858674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-945tl\" (UniqueName: \"kubernetes.io/projected/16b17dd0-d2d3-409a-a3c5-5fe244a48a7b-kube-api-access-945tl\") pod \"cert-manager-webhook-6486ffd997-czt2z\" (UID: \"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:24.012889 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.012849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:24.156217 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.156181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-czt2z"]
Jul 29 01:19:24.161943 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:19:24.161914    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16b17dd0_d2d3_409a_a3c5_5fe244a48a7b.slice/crio-5cf2895215022b61f93a2554a58ffd7d0cbf0bc8a74952dfcb01402b64f48292 WatchSource:0}: Error finding container 5cf2895215022b61f93a2554a58ffd7d0cbf0bc8a74952dfcb01402b64f48292: Status 404 returned error can't find the container with id 5cf2895215022b61f93a2554a58ffd7d0cbf0bc8a74952dfcb01402b64f48292
Jul 29 01:19:24.449663 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.449628    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerID="faffe97d2a321bdefd245caa9b52ca625036b2ef44765c150364ed37ad5e5088" exitCode=0
Jul 29 01:19:24.449828 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.449712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k" event={"ID":"a2eef921-f8b0-4d8a-9bbf-501539ead773","Type":"ContainerDied","Data":"faffe97d2a321bdefd245caa9b52ca625036b2ef44765c150364ed37ad5e5088"}
Jul 29 01:19:24.449828 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.449758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k" event={"ID":"a2eef921-f8b0-4d8a-9bbf-501539ead773","Type":"ContainerStarted","Data":"ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11"}
Jul 29 01:19:24.450869 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:24.450847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z" event={"ID":"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b","Type":"ContainerStarted","Data":"5cf2895215022b61f93a2554a58ffd7d0cbf0bc8a74952dfcb01402b64f48292"}
Jul 29 01:19:25.598039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:25.598004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:25.814974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:25.814926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:26.846936 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.846906    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"]
Jul 29 01:19:26.853176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.853155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:26.855275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.855258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wmv9p\""
Jul 29 01:19:26.859819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.859764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"]
Jul 29 01:19:26.982885 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.982843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:26.983058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:26.982965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5xm\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-kube-api-access-8z5xm\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.083842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.083794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5xm\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-kube-api-access-8z5xm\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.084029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.083870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.098788 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.098703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.098933 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.098843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5xm\" (UniqueName: \"kubernetes.io/projected/2d64db6c-b230-4956-b666-dab3fa7c1d02-kube-api-access-8z5xm\") pod \"cert-manager-cainjector-559cdd8c87-qsg8v\" (UID: \"2d64db6c-b230-4956-b666-dab3fa7c1d02\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.165283 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.165245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"
Jul 29 01:19:27.838032 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.837999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:27.942493 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:27.942371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:28.034748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.034593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v"]
Jul 29 01:19:28.037876 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:19:28.037846    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d64db6c_b230_4956_b666_dab3fa7c1d02.slice/crio-d4a1d4d6772640c583166aaed7eb090caf5a83ab67867ff6552022ef8d241870 WatchSource:0}: Error finding container d4a1d4d6772640c583166aaed7eb090caf5a83ab67867ff6552022ef8d241870: Status 404 returned error can't find the container with id d4a1d4d6772640c583166aaed7eb090caf5a83ab67867ff6552022ef8d241870
Jul 29 01:19:28.473175 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.473091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z" event={"ID":"16b17dd0-d2d3-409a-a3c5-5fe244a48a7b","Type":"ContainerStarted","Data":"4d4600f37ac9c2dea726fb00f71d335d5d5cf371d1d30348c6cc5908146f92b5"}
Jul 29 01:19:28.473350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.473211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:28.474694 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.474664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v" event={"ID":"2d64db6c-b230-4956-b666-dab3fa7c1d02","Type":"ContainerStarted","Data":"8f92d0fee76f544165af9cd03d208c026f3fd2fb8dcebcc01a7b3076eeda0234"}
Jul 29 01:19:28.474843 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.474701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v" event={"ID":"2d64db6c-b230-4956-b666-dab3fa7c1d02","Type":"ContainerStarted","Data":"d4a1d4d6772640c583166aaed7eb090caf5a83ab67867ff6552022ef8d241870"}
Jul 29 01:19:28.476467 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.476443    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerID="ff4f9329e9864a3d93807da09e55f868642229656a074ffb15d06449239ccb51" exitCode=0
Jul 29 01:19:28.476615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.476523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k" event={"ID":"a2eef921-f8b0-4d8a-9bbf-501539ead773","Type":"ContainerDied","Data":"ff4f9329e9864a3d93807da09e55f868642229656a074ffb15d06449239ccb51"}
Jul 29 01:19:28.493156 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.493111    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z" podStartSLOduration=1.760240296 podStartE2EDuration="5.493093689s" totalImagesPullingTime="3.732853393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:28.491254232 +0000 UTC m=+558.520495159" watchObservedRunningTime="2026-07-29 01:19:28.493093689 +0000 UTC m=+558.522334603"
Jul 29 01:19:28.543320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:28.543247    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qsg8v" podStartSLOduration=2.543224588 podStartE2EDuration="2.543224588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:28.543008241 +0000 UTC m=+558.572249155" watchObservedRunningTime="2026-07-29 01:19:28.543224588 +0000 UTC m=+558.572465504"
Jul 29 01:19:29.482745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:29.482714    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerID="23b5da13b06d1dc8881f462fa381ec0eb29c41e6820721263382e43b4f07944b" exitCode=0
Jul 29 01:19:29.483142 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:29.482799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k" event={"ID":"a2eef921-f8b0-4d8a-9bbf-501539ead773","Type":"ContainerDied","Data":"23b5da13b06d1dc8881f462fa381ec0eb29c41e6820721263382e43b4f07944b"}
Jul 29 01:19:30.617733 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.617704    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:30.715158 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.715127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util\") pod \"a2eef921-f8b0-4d8a-9bbf-501539ead773\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") "
Jul 29 01:19:30.715158 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.715164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle\") pod \"a2eef921-f8b0-4d8a-9bbf-501539ead773\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") "
Jul 29 01:19:30.715373 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.715204    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxkdn\" (UniqueName: \"kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn\") pod \"a2eef921-f8b0-4d8a-9bbf-501539ead773\" (UID: \"a2eef921-f8b0-4d8a-9bbf-501539ead773\") "
Jul 29 01:19:30.715654 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.715628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle" (OuterVolumeSpecName: "bundle") pod "a2eef921-f8b0-4d8a-9bbf-501539ead773" (UID: "a2eef921-f8b0-4d8a-9bbf-501539ead773"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:30.717613 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.717570    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn" (OuterVolumeSpecName: "kube-api-access-nxkdn") pod "a2eef921-f8b0-4d8a-9bbf-501539ead773" (UID: "a2eef921-f8b0-4d8a-9bbf-501539ead773"). InnerVolumeSpecName "kube-api-access-nxkdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:30.719549 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.719531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util" (OuterVolumeSpecName: "util") pod "a2eef921-f8b0-4d8a-9bbf-501539ead773" (UID: "a2eef921-f8b0-4d8a-9bbf-501539ead773"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:30.815878 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.815847    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:30.815878 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.815877    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2eef921-f8b0-4d8a-9bbf-501539ead773-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:30.816084 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:30.815888    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxkdn\" (UniqueName: \"kubernetes.io/projected/a2eef921-f8b0-4d8a-9bbf-501539ead773-kube-api-access-nxkdn\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:31.492734 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:31.492697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k" event={"ID":"a2eef921-f8b0-4d8a-9bbf-501539ead773","Type":"ContainerDied","Data":"ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11"}
Jul 29 01:19:31.492929 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:31.492745    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd33fde8e97ee2fb34ef68a921f339bea5588067edf02a7b3ade06850723c11"
Jul 29 01:19:31.492929 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:31.492747    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7b4k"
Jul 29 01:19:33.202195 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:33.202161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:34.485610 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:34.485562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-czt2z"
Jul 29 01:19:35.299050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:35.299018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:35.396615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:35.396559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:41.611891 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:41.611850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:41.711262 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:41.711232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:43.793418 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:43.793388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:45.075440 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:45.075401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:54.806278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:54.806239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:54.865814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:54.865779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:55.775046 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775010    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"]
Jul 29 01:19:55.775370 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775353    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="pull"
Jul 29 01:19:55.775452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775373    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="pull"
Jul 29 01:19:55.775452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775383    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="extract"
Jul 29 01:19:55.775452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775391    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="extract"
Jul 29 01:19:55.775452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775412    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="util"
Jul 29 01:19:55.775452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775421    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="util"
Jul 29 01:19:55.775731 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.775497    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2eef921-f8b0-4d8a-9bbf-501539ead773" containerName="extract"
Jul 29 01:19:55.781284 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.781255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.783640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.783620    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:19:55.784392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.784362    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7r5r\""
Jul 29 01:19:55.784502 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.784435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:19:55.786729 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.786711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"]
Jul 29 01:19:55.822199 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.822164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmvk\" (UniqueName: \"kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.822567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.822246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.822567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.822267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.923092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.923058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmvk\" (UniqueName: \"kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.923258 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.923114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.923258 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.923219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.923504 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.923483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.923543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.923508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:55.931077 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:55.931044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmvk\" (UniqueName: \"kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:56.091812 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:56.091737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:56.222270 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:56.222242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"]
Jul 29 01:19:56.225043 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:19:56.225018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02514a1a_f7fb_48b3_9696_3af2821142c6.slice/crio-367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190 WatchSource:0}: Error finding container 367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190: Status 404 returned error can't find the container with id 367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190
Jul 29 01:19:56.606451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:56.606421    2578 generic.go:356] "Generic (PLEG): container finished" podID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerID="a9e87b7e7b7f9f84077672e873b0ae2e1c9fa2b1c9170d46052dfb28f25696a4" exitCode=0
Jul 29 01:19:56.606692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:56.606515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j" event={"ID":"02514a1a-f7fb-48b3-9696-3af2821142c6","Type":"ContainerDied","Data":"a9e87b7e7b7f9f84077672e873b0ae2e1c9fa2b1c9170d46052dfb28f25696a4"}
Jul 29 01:19:56.606692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:56.606563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j" event={"ID":"02514a1a-f7fb-48b3-9696-3af2821142c6","Type":"ContainerStarted","Data":"367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190"}
Jul 29 01:19:57.613792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:57.613699    2578 generic.go:356] "Generic (PLEG): container finished" podID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerID="2ae8e851b1508bb5d5f65f5e51963b55b5220995888dae195d2648a582ea36e5" exitCode=0
Jul 29 01:19:57.614232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:57.613793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j" event={"ID":"02514a1a-f7fb-48b3-9696-3af2821142c6","Type":"ContainerDied","Data":"2ae8e851b1508bb5d5f65f5e51963b55b5220995888dae195d2648a582ea36e5"}
Jul 29 01:19:58.619937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:58.619907    2578 generic.go:356] "Generic (PLEG): container finished" podID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerID="6350286c7e951367280f02a8293a6d211cbddb15883d8d9f14e59062e176c1c6" exitCode=0
Jul 29 01:19:58.620312 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:58.619944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j" event={"ID":"02514a1a-f7fb-48b3-9696-3af2821142c6","Type":"ContainerDied","Data":"6350286c7e951367280f02a8293a6d211cbddb15883d8d9f14e59062e176c1c6"}
Jul 29 01:19:59.757442 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.757416    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:19:59.849376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.849344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmvk\" (UniqueName: \"kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk\") pod \"02514a1a-f7fb-48b3-9696-3af2821142c6\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") "
Jul 29 01:19:59.849527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.849386    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle\") pod \"02514a1a-f7fb-48b3-9696-3af2821142c6\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") "
Jul 29 01:19:59.849527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.849415    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util\") pod \"02514a1a-f7fb-48b3-9696-3af2821142c6\" (UID: \"02514a1a-f7fb-48b3-9696-3af2821142c6\") "
Jul 29 01:19:59.850162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.850091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle" (OuterVolumeSpecName: "bundle") pod "02514a1a-f7fb-48b3-9696-3af2821142c6" (UID: "02514a1a-f7fb-48b3-9696-3af2821142c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:59.851559 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.851533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk" (OuterVolumeSpecName: "kube-api-access-2gmvk") pod "02514a1a-f7fb-48b3-9696-3af2821142c6" (UID: "02514a1a-f7fb-48b3-9696-3af2821142c6"). InnerVolumeSpecName "kube-api-access-2gmvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:59.855407 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.855374    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util" (OuterVolumeSpecName: "util") pod "02514a1a-f7fb-48b3-9696-3af2821142c6" (UID: "02514a1a-f7fb-48b3-9696-3af2821142c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:59.950544 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.950461    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmvk\" (UniqueName: \"kubernetes.io/projected/02514a1a-f7fb-48b3-9696-3af2821142c6-kube-api-access-2gmvk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:59.950544 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.950489    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:19:59.950544 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:19:59.950499    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02514a1a-f7fb-48b3-9696-3af2821142c6-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:00.631330 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:00.631287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j" event={"ID":"02514a1a-f7fb-48b3-9696-3af2821142c6","Type":"ContainerDied","Data":"367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190"}
Jul 29 01:20:00.631330 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:00.631326    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj5f9j"
Jul 29 01:20:00.631545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:00.631347    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="367e4869693b653def4713a3d4c69ad66b38e7fce694658a4a237a8e69a9e190"
Jul 29 01:20:07.782689 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:07.782658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:07.878367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:07.878333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:08.394415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.394386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:08.718772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.718686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:08.827252 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.827219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:08.871367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"]
Jul 29 01:20:08.871665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871652    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="pull"
Jul 29 01:20:08.871715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871667    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="pull"
Jul 29 01:20:08.871715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871679    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="util"
Jul 29 01:20:08.871715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871684    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="util"
Jul 29 01:20:08.871715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871698    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="extract"
Jul 29 01:20:08.871715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871703    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="extract"
Jul 29 01:20:08.871899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.871747    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02514a1a-f7fb-48b3-9696-3af2821142c6" containerName="extract"
Jul 29 01:20:08.874821 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.874801    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:08.878362 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.878342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:20:08.878515 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.878478    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:20:08.878673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.878648    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:20:08.878673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.878657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:20:08.878837 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.878768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2h4qb\""
Jul 29 01:20:08.897872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.897833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"]
Jul 29 01:20:08.908452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.908429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97r2m\" (UniqueName: \"kubernetes.io/projected/1205a035-b734-4b7d-ba71-eb8054788a73-kube-api-access-97r2m\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:08.908636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.908466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:08.908636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.908484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:08.908636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.908507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:08.908636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:08.908558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009263 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97r2m\" (UniqueName: \"kubernetes.io/projected/1205a035-b734-4b7d-ba71-eb8054788a73-kube-api-access-97r2m\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009447 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.009837 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.009811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.011769 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.011747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1205a035-b734-4b7d-ba71-eb8054788a73-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.011875 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.011858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.011953 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.011937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1205a035-b734-4b7d-ba71-eb8054788a73-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.018872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.018815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97r2m\" (UniqueName: \"kubernetes.io/projected/1205a035-b734-4b7d-ba71-eb8054788a73-kube-api-access-97r2m\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-hlzrp\" (UID: \"1205a035-b734-4b7d-ba71-eb8054788a73\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.066770 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.066738    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.168066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.168031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.185098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.185071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:09.273519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.273492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.323847 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.323794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"]
Jul 29 01:20:09.326635 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:09.326611    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1205a035_b734_4b7d_ba71_eb8054788a73.slice/crio-3ac2433722d06982acd462db133ec4ff0fee448f02ff2ce18a53634063c1c4b9 WatchSource:0}: Error finding container 3ac2433722d06982acd462db133ec4ff0fee448f02ff2ce18a53634063c1c4b9: Status 404 returned error can't find the container with id 3ac2433722d06982acd462db133ec4ff0fee448f02ff2ce18a53634063c1c4b9
Jul 29 01:20:09.377443 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.377395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.519787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.519653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.671111 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:09.671076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp" event={"ID":"1205a035-b734-4b7d-ba71-eb8054788a73","Type":"ContainerStarted","Data":"3ac2433722d06982acd462db133ec4ff0fee448f02ff2ce18a53634063c1c4b9"}
Jul 29 01:20:10.102840 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:10.102773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:10.208119 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:10.208083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:12.689233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:12.689150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp" event={"ID":"1205a035-b734-4b7d-ba71-eb8054788a73","Type":"ContainerStarted","Data":"b397725f4b547b2b044bda1392b113f12473d2923258458f0592b47f318cefc1"}
Jul 29 01:20:13.695873 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:13.695834    2578 generic.go:356] "Generic (PLEG): container finished" podID="1205a035-b734-4b7d-ba71-eb8054788a73" containerID="b397725f4b547b2b044bda1392b113f12473d2923258458f0592b47f318cefc1" exitCode=0
Jul 29 01:20:13.696309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:13.695933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp" event={"ID":"1205a035-b734-4b7d-ba71-eb8054788a73","Type":"ContainerDied","Data":"b397725f4b547b2b044bda1392b113f12473d2923258458f0592b47f318cefc1"}
Jul 29 01:20:14.703467 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:14.703427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp" event={"ID":"1205a035-b734-4b7d-ba71-eb8054788a73","Type":"ContainerStarted","Data":"68b2f5ae3beaf01765d56befeb8ee15588063d9231dd4343ff04a5438b7c6b4c"}
Jul 29 01:20:14.703967 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:14.703528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:14.731584 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:14.731531    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp" podStartSLOduration=2.2819593830000002 podStartE2EDuration="6.731516116s" totalImagesPullingTime="3.414030494s" totalInitContainerRuntime="1.035526239s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:14.728826315 +0000 UTC m=+604.758067235" watchObservedRunningTime="2026-07-29 01:20:14.731516116 +0000 UTC m=+604.760757029"
Jul 29 01:20:25.709764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:25.709731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-hlzrp"
Jul 29 01:20:28.356053 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:28.355999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:29.156012 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.155976    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"]
Jul 29 01:20:29.164090 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.164058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.168169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.168140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 01:20:29.168315 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.168214    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n4jwx\""
Jul 29 01:20:29.170513 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.170487    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"]
Jul 29 01:20:29.170652 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.170511    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 01:20:29.283474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.283435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c925f37-8ee6-475a-9f02-24a97d1500a3-tmp\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.283474 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.283469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdl5p\" (UniqueName: \"kubernetes.io/projected/1c925f37-8ee6-475a-9f02-24a97d1500a3-kube-api-access-sdl5p\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.283717 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.283561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c925f37-8ee6-475a-9f02-24a97d1500a3-tls-certs\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.295939 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.295908    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9l66"]
Jul 29 01:20:29.299280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.299262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.302194 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.302170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 01:20:29.302761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.302739    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tlgbm\""
Jul 29 01:20:29.310342 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.310318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9l66"]
Jul 29 01:20:29.384514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.384479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.384514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.384519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c925f37-8ee6-475a-9f02-24a97d1500a3-tmp\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.385036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.384537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdl5p\" (UniqueName: \"kubernetes.io/projected/1c925f37-8ee6-475a-9f02-24a97d1500a3-kube-api-access-sdl5p\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.385036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.384678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c925f37-8ee6-475a-9f02-24a97d1500a3-tls-certs\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.385036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.384722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cw2x\" (UniqueName: \"kubernetes.io/projected/24f19956-dfc3-4168-b36b-47dbd1091bd6-kube-api-access-9cw2x\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.387065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.387042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c925f37-8ee6-475a-9f02-24a97d1500a3-tmp\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.387242 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.387225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c925f37-8ee6-475a-9f02-24a97d1500a3-tls-certs\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.401146 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.401114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdl5p\" (UniqueName: \"kubernetes.io/projected/1c925f37-8ee6-475a-9f02-24a97d1500a3-kube-api-access-sdl5p\") pod \"kube-auth-proxy-86657cdbcd-cphn7\" (UID: \"1c925f37-8ee6-475a-9f02-24a97d1500a3\") " pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.474465 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.474390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"
Jul 29 01:20:29.486045 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.485888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.486045 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.485939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cw2x\" (UniqueName: \"kubernetes.io/projected/24f19956-dfc3-4168-b36b-47dbd1091bd6-kube-api-access-9cw2x\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.486163 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:20:29.486058    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 01:20:29.486163 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:20:29.486121    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert podName:24f19956-dfc3-4168-b36b-47dbd1091bd6 nodeName:}" failed. No retries permitted until 2026-07-29 01:20:29.986104004 +0000 UTC m=+620.015344899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert") pod "odh-model-controller-7998c67dc4-l9l66" (UID: "24f19956-dfc3-4168-b36b-47dbd1091bd6") : secret "odh-model-controller-webhook-cert" not found
Jul 29 01:20:29.496078 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.496051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cw2x\" (UniqueName: \"kubernetes.io/projected/24f19956-dfc3-4168-b36b-47dbd1091bd6-kube-api-access-9cw2x\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.634061 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.634027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7"]
Jul 29 01:20:29.640209 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:29.640180    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c925f37_8ee6_475a_9f02_24a97d1500a3.slice/crio-e5b44c1f1d993b0dfca433faa216f025961e3520cc3c3ea4977f041e5e9592ba WatchSource:0}: Error finding container e5b44c1f1d993b0dfca433faa216f025961e3520cc3c3ea4977f041e5e9592ba: Status 404 returned error can't find the container with id e5b44c1f1d993b0dfca433faa216f025961e3520cc3c3ea4977f041e5e9592ba
Jul 29 01:20:29.642639 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.642616    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:20:29.772775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.772738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7" event={"ID":"1c925f37-8ee6-475a-9f02-24a97d1500a3","Type":"ContainerStarted","Data":"e5b44c1f1d993b0dfca433faa216f025961e3520cc3c3ea4977f041e5e9592ba"}
Jul 29 01:20:29.920135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.920101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:29.989931 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.989891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:29.993020 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:29.992995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24f19956-dfc3-4168-b36b-47dbd1091bd6-cert\") pod \"odh-model-controller-7998c67dc4-l9l66\" (UID: \"24f19956-dfc3-4168-b36b-47dbd1091bd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:30.210554 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.210450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:30.363689 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.363646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:30.370266 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.370230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9l66"]
Jul 29 01:20:30.373295 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:30.373229    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f19956_dfc3_4168_b36b_47dbd1091bd6.slice/crio-8532400399a01cd1c7f22c83fd6d60bcfc8348a4b2fa10952afe53b0e76076fd WatchSource:0}: Error finding container 8532400399a01cd1c7f22c83fd6d60bcfc8348a4b2fa10952afe53b0e76076fd: Status 404 returned error can't find the container with id 8532400399a01cd1c7f22c83fd6d60bcfc8348a4b2fa10952afe53b0e76076fd
Jul 29 01:20:30.499069 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.499029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:30.500006 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.499976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:30.502949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.502927    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.505488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.505466    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 01:20:30.505488 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.505484    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 01:20:30.505740 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.505521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 01:20:30.505951 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.505927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 01:20:30.506186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.506169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-splfj\""
Jul 29 01:20:30.516092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.516067    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:30.570059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.570024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:30.595115 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595303 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgz9t\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595303 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595303 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.595476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.595409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696027 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.695989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696027 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgz9t\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.696275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.696193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.697051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.697022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.699050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.699024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.699224 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.699200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.699286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.699237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.699286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.699259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.708382 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.708320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.708546 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.708518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgz9t\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t\") pod \"istiod-openshift-gateway-7b7995d5cd-zs7bv\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.780156 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.780071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66" event={"ID":"24f19956-dfc3-4168-b36b-47dbd1091bd6","Type":"ContainerStarted","Data":"8532400399a01cd1c7f22c83fd6d60bcfc8348a4b2fa10952afe53b0e76076fd"}
Jul 29 01:20:30.816545 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.816512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:30.978382 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:30.978351    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:30.980662 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:30.980630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63226f41_48e7_4494_bbd4_32e8ec5151f5.slice/crio-87c6190c5bb96f230e2ec4fe3f9fdf9b35b2196f8f868e5aec115289e50c283b WatchSource:0}: Error finding container 87c6190c5bb96f230e2ec4fe3f9fdf9b35b2196f8f868e5aec115289e50c283b: Status 404 returned error can't find the container with id 87c6190c5bb96f230e2ec4fe3f9fdf9b35b2196f8f868e5aec115289e50c283b
Jul 29 01:20:31.520925 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:31.520867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:31.789736 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:31.789537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" event={"ID":"63226f41-48e7-4494-bbd4-32e8ec5151f5","Type":"ContainerStarted","Data":"87c6190c5bb96f230e2ec4fe3f9fdf9b35b2196f8f868e5aec115289e50c283b"}
Jul 29 01:20:34.806814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:34.806725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66" event={"ID":"24f19956-dfc3-4168-b36b-47dbd1091bd6","Type":"ContainerStarted","Data":"1db0a874e0a2cc4373deb6b0b5a820fe52ccc42a683e7dd8af4523c56f1ad585"}
Jul 29 01:20:34.807278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:34.806882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:20:34.808427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:34.808398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7" event={"ID":"1c925f37-8ee6-475a-9f02-24a97d1500a3","Type":"ContainerStarted","Data":"8a09f04afae68b0aca56d83effd89608d96f9c9ba9b7345d5d8ceba98922a70d"}
Jul 29 01:20:34.822512 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:34.822452    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66" podStartSLOduration=2.356848619 podStartE2EDuration="5.822431167s" totalImagesPullingTime="3.465582548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:34.82240887 +0000 UTC m=+624.851649784" watchObservedRunningTime="2026-07-29 01:20:34.822431167 +0000 UTC m=+624.851672082"
Jul 29 01:20:34.837683 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:34.837622    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86657cdbcd-cphn7" podStartSLOduration=1.684294409 podStartE2EDuration="5.837548646s" totalImagesPullingTime="4.153254237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:34.83693875 +0000 UTC m=+624.866179690" watchObservedRunningTime="2026-07-29 01:20:34.837548646 +0000 UTC m=+624.866789559"
Jul 29 01:20:35.308294 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:35.308247    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:35.308387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:35.308340    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:35.820771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:35.820735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" event={"ID":"63226f41-48e7-4494-bbd4-32e8ec5151f5","Type":"ContainerStarted","Data":"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"}
Jul 29 01:20:35.841452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:35.841397    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" podStartSLOduration=1.5163387130000001 podStartE2EDuration="5.841378241s" totalImagesPullingTime="4.325039528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:35.840517771 +0000 UTC m=+625.869758685" watchObservedRunningTime="2026-07-29 01:20:35.841378241 +0000 UTC m=+625.870619153"
Jul 29 01:20:36.445877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.445840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:36.546319 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.546277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:36.724048 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.723971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:36.798787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.798755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:36.826133 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.826092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:36.827898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.827864    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zs7bv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:20:36.828058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:36.827927    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:20:37.125517 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:37.125483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:37.832175 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:37.832150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:40.521259 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.521229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:40.587922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.587894    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"]
Jul 29 01:20:40.591410 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.591385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.592639 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.592613    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"]
Jul 29 01:20:40.593757 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.593736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 01:20:40.593826 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.593748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-smtbt\""
Jul 29 01:20:40.595626 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.595613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.597685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.597668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 01:20:40.597787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.597708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pllxc\""
Jul 29 01:20:40.601433 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.601411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"]
Jul 29 01:20:40.614836 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.614810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"]
Jul 29 01:20:40.625297 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.625270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:40.687789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.687756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:40.699089 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.699057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.699213 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.699101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-cert\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.699213 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.699182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqt4v\" (UniqueName: \"kubernetes.io/projected/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-kube-api-access-lqt4v\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.699323 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.699245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vct67\" (UniqueName: \"kubernetes.io/projected/f9b2adb7-ba90-4b16-8887-c60a879f990e-kube-api-access-vct67\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.799755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.799666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.799755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.799708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-cert\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.799755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.799748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqt4v\" (UniqueName: \"kubernetes.io/projected/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-kube-api-access-lqt4v\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.799996 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.799778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vct67\" (UniqueName: \"kubernetes.io/projected/f9b2adb7-ba90-4b16-8887-c60a879f990e-kube-api-access-vct67\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.799996 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:20:40.799841    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 29 01:20:40.799996 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:20:40.799923    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert podName:f9b2adb7-ba90-4b16-8887-c60a879f990e nodeName:}" failed. No retries permitted until 2026-07-29 01:20:41.299901717 +0000 UTC m=+631.329142620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert") pod "llmisvc-controller-manager-777c6bd7d5-qg9dv" (UID: "f9b2adb7-ba90-4b16-8887-c60a879f990e") : secret "llmisvc-webhook-server-cert" not found
Jul 29 01:20:40.802377 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.802354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-cert\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.817426 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.817397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqt4v\" (UniqueName: \"kubernetes.io/projected/84b602ad-ee5c-428e-b1bb-56f0ebefcd61-kube-api-access-lqt4v\") pod \"kserve-controller-manager-d6f4b65b8-m98g7\" (UID: \"84b602ad-ee5c-428e-b1bb-56f0ebefcd61\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:40.823037 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.823013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vct67\" (UniqueName: \"kubernetes.io/projected/f9b2adb7-ba90-4b16-8887-c60a879f990e-kube-api-access-vct67\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:40.904091 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:40.904055    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:41.047291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.047261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"]
Jul 29 01:20:41.049198 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:41.049175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b602ad_ee5c_428e_b1bb_56f0ebefcd61.slice/crio-6bb850242cff01ecc97b44d4d7dbba6135afe73bb8d162be3c5c99471fe0bb9d WatchSource:0}: Error finding container 6bb850242cff01ecc97b44d4d7dbba6135afe73bb8d162be3c5c99471fe0bb9d: Status 404 returned error can't find the container with id 6bb850242cff01ecc97b44d4d7dbba6135afe73bb8d162be3c5c99471fe0bb9d
Jul 29 01:20:41.074979 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.074939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:41.304995 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.304915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:41.307468 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.307443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9b2adb7-ba90-4b16-8887-c60a879f990e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg9dv\" (UID: \"f9b2adb7-ba90-4b16-8887-c60a879f990e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:41.509241 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.509201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:41.650559 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.650535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"]
Jul 29 01:20:41.653048 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:20:41.653021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9b2adb7_ba90_4b16_8887_c60a879f990e.slice/crio-a8a054cb460028e93a905f910027af1d4f874573e826f2efbfc3c30f38c8b8db WatchSource:0}: Error finding container a8a054cb460028e93a905f910027af1d4f874573e826f2efbfc3c30f38c8b8db: Status 404 returned error can't find the container with id a8a054cb460028e93a905f910027af1d4f874573e826f2efbfc3c30f38c8b8db
Jul 29 01:20:41.819643 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.819548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:41.858644 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.858569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv" event={"ID":"f9b2adb7-ba90-4b16-8887-c60a879f990e","Type":"ContainerStarted","Data":"a8a054cb460028e93a905f910027af1d4f874573e826f2efbfc3c30f38c8b8db"}
Jul 29 01:20:41.859848 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.859817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7" event={"ID":"84b602ad-ee5c-428e-b1bb-56f0ebefcd61","Type":"ContainerStarted","Data":"6bb850242cff01ecc97b44d4d7dbba6135afe73bb8d162be3c5c99471fe0bb9d"}
Jul 29 01:20:41.946129 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:41.946078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:42.057995 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:42.057956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:43.321511 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.321480    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:43.321929 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.321705    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerName="discovery" containerID="cri-o://5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d" gracePeriod=30
Jul 29 01:20:43.662189 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.662150    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:43.829849 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.829818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.829868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.829904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.829925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.829978    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgz9t\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.830004    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.830307 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.830047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs\") pod \"63226f41-48e7-4494-bbd4-32e8ec5151f5\" (UID: \"63226f41-48e7-4494-bbd4-32e8ec5151f5\") "
Jul 29 01:20:43.831066 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.831026    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:43.834242 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.833522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:43.835526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.835008    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:43.835526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.835101    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t" (OuterVolumeSpecName: "kube-api-access-mgz9t") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "kube-api-access-mgz9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:43.835526 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.835187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:43.836143 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.835597    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs" (OuterVolumeSpecName: "local-certs") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:20:43.836914 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.836882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts" (OuterVolumeSpecName: "cacerts") pod "63226f41-48e7-4494-bbd4-32e8ec5151f5" (UID: "63226f41-48e7-4494-bbd4-32e8ec5151f5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:43.873480 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.873400    2578 generic.go:356] "Generic (PLEG): container finished" podID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerID="5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d" exitCode=0
Jul 29 01:20:43.873480 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.873448    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"
Jul 29 01:20:43.876855 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.873490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" event={"ID":"63226f41-48e7-4494-bbd4-32e8ec5151f5","Type":"ContainerDied","Data":"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"}
Jul 29 01:20:43.876855 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.873566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv" event={"ID":"63226f41-48e7-4494-bbd4-32e8ec5151f5","Type":"ContainerDied","Data":"87c6190c5bb96f230e2ec4fe3f9fdf9b35b2196f8f868e5aec115289e50c283b"}
Jul 29 01:20:43.876855 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.873629    2578 scope.go:117] "RemoveContainer" containerID="5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"
Jul 29 01:20:43.876855 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.875461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7" event={"ID":"84b602ad-ee5c-428e-b1bb-56f0ebefcd61","Type":"ContainerStarted","Data":"3260c9167b8effaec6bcdef55204ed5dfc14d8dfecc1b2d938dcd467e860bb56"}
Jul 29 01:20:43.886205 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.886183    2578 scope.go:117] "RemoveContainer" containerID="5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"
Jul 29 01:20:43.886528 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:20:43.886508    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d\": container with ID starting with 5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d not found: ID does not exist" containerID="5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"
Jul 29 01:20:43.886645 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.886536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d"} err="failed to get container status \"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d\": rpc error: code = NotFound desc = could not find container \"5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d\": container with ID starting with 5a7d174414884def990a2efba84623fe8887f802a487094111ed02bfac4ef60d not found: ID does not exist"
Jul 29 01:20:43.896062 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.896013    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7" podStartSLOduration=1.350501891 podStartE2EDuration="3.895995942s" totalImagesPullingTime="2.545494051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:43.894858599 +0000 UTC m=+633.924099515" watchObservedRunningTime="2026-07-29 01:20:43.895995942 +0000 UTC m=+633.925236854"
Jul 29 01:20:43.913866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.913829    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:43.919007 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.918975    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zs7bv"]
Jul 29 01:20:43.930726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930698    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-cacerts\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.930726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930723    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-dns-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.930726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930733    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgz9t\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-kube-api-access-mgz9t\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.930726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930742    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-csr-ca-configmap\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.931059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930757    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63226f41-48e7-4494-bbd4-32e8ec5151f5-local-certs\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.931059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930769    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-kubeconfig\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:43.931059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:43.930779    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63226f41-48e7-4494-bbd4-32e8ec5151f5-istio-token\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:20:44.471858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:44.471819    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" path="/var/lib/kubelet/pods/63226f41-48e7-4494-bbd4-32e8ec5151f5/volumes"
Jul 29 01:20:44.882471 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:44.882422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv" event={"ID":"f9b2adb7-ba90-4b16-8887-c60a879f990e","Type":"ContainerStarted","Data":"388c27f71ffd336b5d4242d7d140bc99ca150492bb88a7d8f60c8863c23fb462"}
Jul 29 01:20:44.882697 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:44.882676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:20:44.882759 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:44.882725    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:20:44.902163 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:44.902109    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv" podStartSLOduration=1.974110491 podStartE2EDuration="4.90209053s" totalImagesPullingTime="2.927980039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:44.89996076 +0000 UTC m=+634.929201674" watchObservedRunningTime="2026-07-29 01:20:44.90209053 +0000 UTC m=+634.931331444"
Jul 29 01:20:45.823831 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:20:45.823800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l9l66"
Jul 29 01:21:15.889328 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:15.889296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg9dv"
Jul 29 01:21:15.892350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:15.892331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m98g7"
Jul 29 01:21:17.041332 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:17.041303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:17.138061 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:17.138008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:23.418175 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:23.418137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:25.462561 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:25.462530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:25.564000 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:25.563969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:29.754734 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.754699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:29.854704 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.854650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:29.883909 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.883877    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:29.884190 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.884179    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerName="discovery"
Jul 29 01:21:29.884232 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.884193    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerName="discovery"
Jul 29 01:21:29.884265 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.884261    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="63226f41-48e7-4494-bbd4-32e8ec5151f5" containerName="discovery"
Jul 29 01:21:29.898189 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.898158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:29.899460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.899431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:29.900849 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.900818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 01:21:29.901379 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.901353    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 01:21:29.901470 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.901356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mr7qj\""
Jul 29 01:21:29.931919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:29.931890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:30.011401 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.011305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66khr\" (UniqueName: \"kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr\") pod \"kuadrant-operator-catalog-cr7tw\" (UID: \"8513158b-6989-47dd-99d5-4cdf58ba2211\") " pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:30.112290 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.112260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66khr\" (UniqueName: \"kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr\") pod \"kuadrant-operator-catalog-cr7tw\" (UID: \"8513158b-6989-47dd-99d5-4cdf58ba2211\") " pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:30.120608 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.120556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66khr\" (UniqueName: \"kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr\") pod \"kuadrant-operator-catalog-cr7tw\" (UID: \"8513158b-6989-47dd-99d5-4cdf58ba2211\") " pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:30.208481 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.208449    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:30.250871 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.250836    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:30.339456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.339433    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:30.341988 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:30.341962    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8513158b_6989_47dd_99d5_4cdf58ba2211.slice/crio-c15fcf6c4eba10bed90acad5236aa2cc23137bdd5a9876e619438187c9580198 WatchSource:0}: Error finding container c15fcf6c4eba10bed90acad5236aa2cc23137bdd5a9876e619438187c9580198: Status 404 returned error can't find the container with id c15fcf6c4eba10bed90acad5236aa2cc23137bdd5a9876e619438187c9580198
Jul 29 01:21:30.460607 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.460567    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6xtb"]
Jul 29 01:21:30.466760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.466741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:30.473489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.473462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6xtb"]
Jul 29 01:21:30.617961 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.617874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2x9x\" (UniqueName: \"kubernetes.io/projected/e4907d7c-cec7-44e1-b4cf-62d2d5fcb682-kube-api-access-b2x9x\") pod \"kuadrant-operator-catalog-r6xtb\" (UID: \"e4907d7c-cec7-44e1-b4cf-62d2d5fcb682\") " pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:30.684238 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.684201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:30.719192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.719161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2x9x\" (UniqueName: \"kubernetes.io/projected/e4907d7c-cec7-44e1-b4cf-62d2d5fcb682-kube-api-access-b2x9x\") pod \"kuadrant-operator-catalog-r6xtb\" (UID: \"e4907d7c-cec7-44e1-b4cf-62d2d5fcb682\") " pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:30.730561 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.730526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2x9x\" (UniqueName: \"kubernetes.io/projected/e4907d7c-cec7-44e1-b4cf-62d2d5fcb682-kube-api-access-b2x9x\") pod \"kuadrant-operator-catalog-r6xtb\" (UID: \"e4907d7c-cec7-44e1-b4cf-62d2d5fcb682\") " pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:30.777918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.777884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:30.891562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.891449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:30.919136 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:30.919110    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6xtb"]
Jul 29 01:21:30.921450 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:30.921425    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4907d7c_cec7_44e1_b4cf_62d2d5fcb682.slice/crio-dfabb610d57a073121d5fcc22a918ccffb7122b95951ef0c89e3f3807e2338d3 WatchSource:0}: Error finding container dfabb610d57a073121d5fcc22a918ccffb7122b95951ef0c89e3f3807e2338d3: Status 404 returned error can't find the container with id dfabb610d57a073121d5fcc22a918ccffb7122b95951ef0c89e3f3807e2338d3
Jul 29 01:21:31.103818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:31.103774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" event={"ID":"8513158b-6989-47dd-99d5-4cdf58ba2211","Type":"ContainerStarted","Data":"c15fcf6c4eba10bed90acad5236aa2cc23137bdd5a9876e619438187c9580198"}
Jul 29 01:21:31.105072 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:31.105034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb" event={"ID":"e4907d7c-cec7-44e1-b4cf-62d2d5fcb682","Type":"ContainerStarted","Data":"dfabb610d57a073121d5fcc22a918ccffb7122b95951ef0c89e3f3807e2338d3"}
Jul 29 01:21:33.116942 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.116895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" event={"ID":"8513158b-6989-47dd-99d5-4cdf58ba2211","Type":"ContainerStarted","Data":"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"}
Jul 29 01:21:33.116942 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.116934    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" podUID="8513158b-6989-47dd-99d5-4cdf58ba2211" containerName="registry-server" containerID="cri-o://c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c" gracePeriod=2
Jul 29 01:21:33.118410 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.118386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb" event={"ID":"e4907d7c-cec7-44e1-b4cf-62d2d5fcb682","Type":"ContainerStarted","Data":"1e92fc276a0c2d0b66d0a81fb36a0e14ac791ad9ebcd1e8f4c78707fb7f002d1"}
Jul 29 01:21:33.133621 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.133556    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" podStartSLOduration=2.170142381 podStartE2EDuration="4.133533888s" totalImagesPullingTime="1.963391507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:33.133020271 +0000 UTC m=+683.162261184" watchObservedRunningTime="2026-07-29 01:21:33.133533888 +0000 UTC m=+683.162774800"
Jul 29 01:21:33.148250 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.148203    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb" podStartSLOduration=1.763686587 podStartE2EDuration="3.148188994s" totalImagesPullingTime="1.384502407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:33.147107119 +0000 UTC m=+683.176348032" watchObservedRunningTime="2026-07-29 01:21:33.148188994 +0000 UTC m=+683.177429906"
Jul 29 01:21:33.362168 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.362144    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:33.444137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.444049    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66khr\" (UniqueName: \"kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr\") pod \"8513158b-6989-47dd-99d5-4cdf58ba2211\" (UID: \"8513158b-6989-47dd-99d5-4cdf58ba2211\") "
Jul 29 01:21:33.446303 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.446277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr" (OuterVolumeSpecName: "kube-api-access-66khr") pod "8513158b-6989-47dd-99d5-4cdf58ba2211" (UID: "8513158b-6989-47dd-99d5-4cdf58ba2211"). InnerVolumeSpecName "kube-api-access-66khr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:33.545007 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:33.544972    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66khr\" (UniqueName: \"kubernetes.io/projected/8513158b-6989-47dd-99d5-4cdf58ba2211-kube-api-access-66khr\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:34.125028 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.124991    2578 generic.go:356] "Generic (PLEG): container finished" podID="8513158b-6989-47dd-99d5-4cdf58ba2211" containerID="c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c" exitCode=0
Jul 29 01:21:34.125413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.125033    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw"
Jul 29 01:21:34.125413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.125076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" event={"ID":"8513158b-6989-47dd-99d5-4cdf58ba2211","Type":"ContainerDied","Data":"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"}
Jul 29 01:21:34.125413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.125128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr7tw" event={"ID":"8513158b-6989-47dd-99d5-4cdf58ba2211","Type":"ContainerDied","Data":"c15fcf6c4eba10bed90acad5236aa2cc23137bdd5a9876e619438187c9580198"}
Jul 29 01:21:34.125413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.125150    2578 scope.go:117] "RemoveContainer" containerID="c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"
Jul 29 01:21:34.134611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.134590    2578 scope.go:117] "RemoveContainer" containerID="c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"
Jul 29 01:21:34.134866 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:21:34.134849    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c\": container with ID starting with c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c not found: ID does not exist" containerID="c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"
Jul 29 01:21:34.134910 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.134876    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c"} err="failed to get container status \"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c\": rpc error: code = NotFound desc = could not find container \"c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c\": container with ID starting with c2b860f2c9cbb81a721ecd24beadebf3b8e77652b66cae83c208bd10cf583d1c not found: ID does not exist"
Jul 29 01:21:34.144818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.144796    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:34.149320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.149301    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr7tw"]
Jul 29 01:21:34.471236 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:34.471161    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8513158b-6989-47dd-99d5-4cdf58ba2211" path="/var/lib/kubelet/pods/8513158b-6989-47dd-99d5-4cdf58ba2211/volumes"
Jul 29 01:21:40.778054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:40.778006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:40.778465 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:40.778080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:40.799940 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:40.799917    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:41.178261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:41.178192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r6xtb"
Jul 29 01:21:45.040879 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.040845    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55c6cbb86c-2b4wd"]
Jul 29 01:21:45.041247 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.041189    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8513158b-6989-47dd-99d5-4cdf58ba2211" containerName="registry-server"
Jul 29 01:21:45.041247 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.041200    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8513158b-6989-47dd-99d5-4cdf58ba2211" containerName="registry-server"
Jul 29 01:21:45.041314 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.041257    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8513158b-6989-47dd-99d5-4cdf58ba2211" containerName="registry-server"
Jul 29 01:21:45.045421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.045403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.057121 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.057095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c6cbb86c-2b4wd"]
Jul 29 01:21:45.110016 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.109960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:45.138162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-service-ca\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-oauth-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-oauth-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsmv5\" (UniqueName: \"kubernetes.io/projected/50c065b9-8d95-4237-ac79-a26dcfcd76c9-kube-api-access-dsmv5\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.138427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.138340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-trusted-ca-bundle\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.238462 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:45.238858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.238948 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.238948 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-oauth-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.238948 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-oauth-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.239104 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.238970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsmv5\" (UniqueName: \"kubernetes.io/projected/50c065b9-8d95-4237-ac79-a26dcfcd76c9-kube-api-access-dsmv5\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.239104 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.239028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-trusted-ca-bundle\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.239104 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.239095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-service-ca\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.239880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.239857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-oauth-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.239971 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.239923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.240183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.240163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-service-ca\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.240240 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.240210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c065b9-8d95-4237-ac79-a26dcfcd76c9-trusted-ca-bundle\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.241402 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.241372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-oauth-config\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.241632 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.241616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c065b9-8d95-4237-ac79-a26dcfcd76c9-console-serving-cert\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.246910 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.246886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsmv5\" (UniqueName: \"kubernetes.io/projected/50c065b9-8d95-4237-ac79-a26dcfcd76c9-kube-api-access-dsmv5\") pod \"console-55c6cbb86c-2b4wd\" (UID: \"50c065b9-8d95-4237-ac79-a26dcfcd76c9\") " pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.293823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.293746    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"]
Jul 29 01:21:45.298373 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.298357    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.300456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.300436    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ls6zt\""
Jul 29 01:21:45.304179 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.304159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"]
Jul 29 01:21:45.306789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.306768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:45.354456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.354408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:45.441292 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.441259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jrb\" (UniqueName: \"kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.441437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.441327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.441437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.441362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.487845 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.487821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c6cbb86c-2b4wd"]
Jul 29 01:21:45.489722 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:45.489690    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c065b9_8d95_4237_ac79_a26dcfcd76c9.slice/crio-77a5b74a78aa563a379b954d9a85a2af3398dd076decbcc23d269d5b2a8f2ed4 WatchSource:0}: Error finding container 77a5b74a78aa563a379b954d9a85a2af3398dd076decbcc23d269d5b2a8f2ed4: Status 404 returned error can't find the container with id 77a5b74a78aa563a379b954d9a85a2af3398dd076decbcc23d269d5b2a8f2ed4
Jul 29 01:21:45.542696 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.542674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.542794 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.542707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.542794 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.542771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jrb\" (UniqueName: \"kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.543097 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.543077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.543140 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.543088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.550399 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.550333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jrb\" (UniqueName: \"kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.608482 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.608452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:45.740653 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.740632    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"]
Jul 29 01:21:45.743051 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:45.743022    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05e307c_b575_48e1_9570_14554d5a0b6e.slice/crio-13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24 WatchSource:0}: Error finding container 13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24: Status 404 returned error can't find the container with id 13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24
Jul 29 01:21:45.837660 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.837626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:45.895400 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.895372    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"]
Jul 29 01:21:45.898909 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.898893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:45.908424 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.908399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"]
Jul 29 01:21:45.908685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:45.908654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:46.046894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.046861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.047301 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.046926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrfc\" (UniqueName: \"kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.047301 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.046995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.147749 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.147661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.147749 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.147747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrfc\" (UniqueName: \"kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.147989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.147781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.148053 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.147995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.148166 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.148144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.155825 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.155799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrfc\" (UniqueName: \"kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.186141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.186109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c6cbb86c-2b4wd" event={"ID":"50c065b9-8d95-4237-ac79-a26dcfcd76c9","Type":"ContainerStarted","Data":"a3d728a25a269555fbe56dabd632aeab254b4eab746e48335d4bf9e26c4ffef3"}
Jul 29 01:21:46.186273 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.186156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c6cbb86c-2b4wd" event={"ID":"50c065b9-8d95-4237-ac79-a26dcfcd76c9","Type":"ContainerStarted","Data":"77a5b74a78aa563a379b954d9a85a2af3398dd076decbcc23d269d5b2a8f2ed4"}
Jul 29 01:21:46.187619 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.187595    2578 generic.go:356] "Generic (PLEG): container finished" podID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerID="8f9ced2183da211f83c2e4df8e287062cd15a432e171523693034002422f2c05" exitCode=0
Jul 29 01:21:46.187829 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.187676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q" event={"ID":"b05e307c-b575-48e1-9570-14554d5a0b6e","Type":"ContainerDied","Data":"8f9ced2183da211f83c2e4df8e287062cd15a432e171523693034002422f2c05"}
Jul 29 01:21:46.187829 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.187713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q" event={"ID":"b05e307c-b575-48e1-9570-14554d5a0b6e","Type":"ContainerStarted","Data":"13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24"}
Jul 29 01:21:46.204116 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.204064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55c6cbb86c-2b4wd" podStartSLOduration=1.204048979 podStartE2EDuration="1.204048979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:46.201787164 +0000 UTC m=+696.231028077" watchObservedRunningTime="2026-07-29 01:21:46.204048979 +0000 UTC m=+696.233289892"
Jul 29 01:21:46.207747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.207729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:46.342158 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.342137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"]
Jul 29 01:21:46.343916 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:46.343889    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7042da3f_cd46_4647_bd40_7ef522099056.slice/crio-e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f WatchSource:0}: Error finding container e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f: Status 404 returned error can't find the container with id e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f
Jul 29 01:21:46.496179 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.496141    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"]
Jul 29 01:21:46.501766 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.501743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.505029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.505005    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"]
Jul 29 01:21:46.652412 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.652339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.652412 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.652386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.652640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.652421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfh4m\" (UniqueName: \"kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.752932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.752890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.753188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.752956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.753188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.752993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfh4m\" (UniqueName: \"kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.753360 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.753335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.753396 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.753342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.761350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.761318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfh4m\" (UniqueName: \"kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.824386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.824356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:46.893647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.893613    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"]
Jul 29 01:21:46.897195 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.897171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:46.906344 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.906316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"]
Jul 29 01:21:46.971672 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:46.971645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"]
Jul 29 01:21:47.009499 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:47.009463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130b87d0_4259_4e0c_a4aa_3f89855a9993.slice/crio-5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8 WatchSource:0}: Error finding container 5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8: Status 404 returned error can't find the container with id 5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8
Jul 29 01:21:47.056228 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.056148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.056228 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.056180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.056615 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.056228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc85m\" (UniqueName: \"kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.156886 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.156816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.156886 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.156859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.157076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.156916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc85m\" (UniqueName: \"kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.157268 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.157251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.157364 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.157343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.167079 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.167056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc85m\" (UniqueName: \"kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.193384 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.193354    2578 generic.go:356] "Generic (PLEG): container finished" podID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerID="7c8d21d955eee4abbb166434d6c72bbfba4cbd11786e5f26a5a1419e5e82b60e" exitCode=0
Jul 29 01:21:47.193553 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.193446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7" event={"ID":"130b87d0-4259-4e0c-a4aa-3f89855a9993","Type":"ContainerDied","Data":"7c8d21d955eee4abbb166434d6c72bbfba4cbd11786e5f26a5a1419e5e82b60e"}
Jul 29 01:21:47.193553 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.193503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7" event={"ID":"130b87d0-4259-4e0c-a4aa-3f89855a9993","Type":"ContainerStarted","Data":"5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8"}
Jul 29 01:21:47.195001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.194940    2578 generic.go:356] "Generic (PLEG): container finished" podID="7042da3f-cd46-4647-bd40-7ef522099056" containerID="3a2cd902683fc7a4b6c4457d31204c32bb158f44022696c6f43795fd3ff277bf" exitCode=0
Jul 29 01:21:47.195001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.194969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt" event={"ID":"7042da3f-cd46-4647-bd40-7ef522099056","Type":"ContainerDied","Data":"3a2cd902683fc7a4b6c4457d31204c32bb158f44022696c6f43795fd3ff277bf"}
Jul 29 01:21:47.195150 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.195007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt" event={"ID":"7042da3f-cd46-4647-bd40-7ef522099056","Type":"ContainerStarted","Data":"e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f"}
Jul 29 01:21:47.197013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.196992    2578 generic.go:356] "Generic (PLEG): container finished" podID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerID="d278aa8470b8e7e3b3ff2ae0249e9bd4520154bd96f8d9cb56e83bae83185cdc" exitCode=0
Jul 29 01:21:47.197138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.197055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q" event={"ID":"b05e307c-b575-48e1-9570-14554d5a0b6e","Type":"ContainerDied","Data":"d278aa8470b8e7e3b3ff2ae0249e9bd4520154bd96f8d9cb56e83bae83185cdc"}
Jul 29 01:21:47.208988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.208959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:47.350531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:47.350506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"]
Jul 29 01:21:47.407484 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:21:47.407409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba7f9cd_54ec_4928_a9d2_a41c4c9760c1.slice/crio-964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c WatchSource:0}: Error finding container 964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c: Status 404 returned error can't find the container with id 964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c
Jul 29 01:21:48.205067 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.204971    2578 generic.go:356] "Generic (PLEG): container finished" podID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerID="2a4dd9c574c8e35f8268feb859f2850d0ecc3eb2d678f1cc4e09487d696b469c" exitCode=0
Jul 29 01:21:48.205067 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.205051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7" event={"ID":"130b87d0-4259-4e0c-a4aa-3f89855a9993","Type":"ContainerDied","Data":"2a4dd9c574c8e35f8268feb859f2850d0ecc3eb2d678f1cc4e09487d696b469c"}
Jul 29 01:21:48.206961 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.206897    2578 generic.go:356] "Generic (PLEG): container finished" podID="7042da3f-cd46-4647-bd40-7ef522099056" containerID="dbd42e18b05a3975ac7488f2ebe035114be1d8b485d67d8b8847e9a3219f86d0" exitCode=0
Jul 29 01:21:48.206961 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.206924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt" event={"ID":"7042da3f-cd46-4647-bd40-7ef522099056","Type":"ContainerDied","Data":"dbd42e18b05a3975ac7488f2ebe035114be1d8b485d67d8b8847e9a3219f86d0"}
Jul 29 01:21:48.208522 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.208487    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerID="3e151234d02e6b1c352292509c256a1bdf797f1eeb83d1472a60ba8e0c4927b1" exitCode=0
Jul 29 01:21:48.208623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.208604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz" event={"ID":"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1","Type":"ContainerDied","Data":"3e151234d02e6b1c352292509c256a1bdf797f1eeb83d1472a60ba8e0c4927b1"}
Jul 29 01:21:48.208680 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.208636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz" event={"ID":"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1","Type":"ContainerStarted","Data":"964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c"}
Jul 29 01:21:48.210895 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.210841    2578 generic.go:356] "Generic (PLEG): container finished" podID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerID="2ad828f272f442e31f2043e1545ec6441c049902566f56e78d2d8c562eb0643b" exitCode=0
Jul 29 01:21:48.210964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:48.210901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q" event={"ID":"b05e307c-b575-48e1-9570-14554d5a0b6e","Type":"ContainerDied","Data":"2ad828f272f442e31f2043e1545ec6441c049902566f56e78d2d8c562eb0643b"}
Jul 29 01:21:49.217747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.217655    2578 generic.go:356] "Generic (PLEG): container finished" podID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerID="8da0cfea2ce20cf10056669e4a8921cffe33cafc31c94adaffc3e0995aca6cb8" exitCode=0
Jul 29 01:21:49.218148 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.217734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7" event={"ID":"130b87d0-4259-4e0c-a4aa-3f89855a9993","Type":"ContainerDied","Data":"8da0cfea2ce20cf10056669e4a8921cffe33cafc31c94adaffc3e0995aca6cb8"}
Jul 29 01:21:49.219676 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.219650    2578 generic.go:356] "Generic (PLEG): container finished" podID="7042da3f-cd46-4647-bd40-7ef522099056" containerID="7f616b86716f84c9c3ede5bd599f59dc031f5814682fa5fe8dfc84838f5e336b" exitCode=0
Jul 29 01:21:49.219787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.219692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt" event={"ID":"7042da3f-cd46-4647-bd40-7ef522099056","Type":"ContainerDied","Data":"7f616b86716f84c9c3ede5bd599f59dc031f5814682fa5fe8dfc84838f5e336b"}
Jul 29 01:21:49.221507 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.221485    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerID="86a546c35dd732968f266b805b277f008203f38e0335001b6da1e63177e0341b" exitCode=0
Jul 29 01:21:49.221654 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.221561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz" event={"ID":"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1","Type":"ContainerDied","Data":"86a546c35dd732968f266b805b277f008203f38e0335001b6da1e63177e0341b"}
Jul 29 01:21:49.362981 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.362957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:49.476050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.475959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2jrb\" (UniqueName: \"kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb\") pod \"b05e307c-b575-48e1-9570-14554d5a0b6e\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") "
Jul 29 01:21:49.476050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.476028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle\") pod \"b05e307c-b575-48e1-9570-14554d5a0b6e\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") "
Jul 29 01:21:49.476050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.476054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util\") pod \"b05e307c-b575-48e1-9570-14554d5a0b6e\" (UID: \"b05e307c-b575-48e1-9570-14554d5a0b6e\") "
Jul 29 01:21:49.476470 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.476438    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle" (OuterVolumeSpecName: "bundle") pod "b05e307c-b575-48e1-9570-14554d5a0b6e" (UID: "b05e307c-b575-48e1-9570-14554d5a0b6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:49.478234 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.478201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb" (OuterVolumeSpecName: "kube-api-access-n2jrb") pod "b05e307c-b575-48e1-9570-14554d5a0b6e" (UID: "b05e307c-b575-48e1-9570-14554d5a0b6e"). InnerVolumeSpecName "kube-api-access-n2jrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:49.481524 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.481507    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util" (OuterVolumeSpecName: "util") pod "b05e307c-b575-48e1-9570-14554d5a0b6e" (UID: "b05e307c-b575-48e1-9570-14554d5a0b6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:49.576974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.576939    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2jrb\" (UniqueName: \"kubernetes.io/projected/b05e307c-b575-48e1-9570-14554d5a0b6e-kube-api-access-n2jrb\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:49.576974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.576969    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:49.576974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:49.576982    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b05e307c-b575-48e1-9570-14554d5a0b6e-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.229410 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.229373    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerID="f78af6f7db3fd09e96f6244c6fbd28b527a39c478682d9e307851b229d5916e2" exitCode=0
Jul 29 01:21:50.229852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.229459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz" event={"ID":"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1","Type":"ContainerDied","Data":"f78af6f7db3fd09e96f6244c6fbd28b527a39c478682d9e307851b229d5916e2"}
Jul 29 01:21:50.231221 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.231201    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q"
Jul 29 01:21:50.231350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.231219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q" event={"ID":"b05e307c-b575-48e1-9570-14554d5a0b6e","Type":"ContainerDied","Data":"13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24"}
Jul 29 01:21:50.231350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.231258    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13098a5db037b2be466e0d40de9a71745bb83f8d5ffd6b1aba5c649ab9717a24"
Jul 29 01:21:50.395476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.395454    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:50.397491 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.397476    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:50.585833 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.585802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util\") pod \"130b87d0-4259-4e0c-a4aa-3f89855a9993\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") "
Jul 29 01:21:50.586033 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.585884    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrfc\" (UniqueName: \"kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc\") pod \"7042da3f-cd46-4647-bd40-7ef522099056\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") "
Jul 29 01:21:50.586033 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.585902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle\") pod \"130b87d0-4259-4e0c-a4aa-3f89855a9993\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") "
Jul 29 01:21:50.586033 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.585965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfh4m\" (UniqueName: \"kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m\") pod \"130b87d0-4259-4e0c-a4aa-3f89855a9993\" (UID: \"130b87d0-4259-4e0c-a4aa-3f89855a9993\") "
Jul 29 01:21:50.586243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.586082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle\") pod \"7042da3f-cd46-4647-bd40-7ef522099056\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") "
Jul 29 01:21:50.586243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.586132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util\") pod \"7042da3f-cd46-4647-bd40-7ef522099056\" (UID: \"7042da3f-cd46-4647-bd40-7ef522099056\") "
Jul 29 01:21:50.586768 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.586622    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle" (OuterVolumeSpecName: "bundle") pod "7042da3f-cd46-4647-bd40-7ef522099056" (UID: "7042da3f-cd46-4647-bd40-7ef522099056"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:50.586768 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.586730    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle" (OuterVolumeSpecName: "bundle") pod "130b87d0-4259-4e0c-a4aa-3f89855a9993" (UID: "130b87d0-4259-4e0c-a4aa-3f89855a9993"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:50.588304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.588278    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc" (OuterVolumeSpecName: "kube-api-access-tbrfc") pod "7042da3f-cd46-4647-bd40-7ef522099056" (UID: "7042da3f-cd46-4647-bd40-7ef522099056"). InnerVolumeSpecName "kube-api-access-tbrfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:50.588472 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.588455    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m" (OuterVolumeSpecName: "kube-api-access-bfh4m") pod "130b87d0-4259-4e0c-a4aa-3f89855a9993" (UID: "130b87d0-4259-4e0c-a4aa-3f89855a9993"). InnerVolumeSpecName "kube-api-access-bfh4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:50.592059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.592038    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util" (OuterVolumeSpecName: "util") pod "130b87d0-4259-4e0c-a4aa-3f89855a9993" (UID: "130b87d0-4259-4e0c-a4aa-3f89855a9993"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:50.592378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.592360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util" (OuterVolumeSpecName: "util") pod "7042da3f-cd46-4647-bd40-7ef522099056" (UID: "7042da3f-cd46-4647-bd40-7ef522099056"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:50.687114 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687079    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.687114 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687107    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.687114 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687118    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrfc\" (UniqueName: \"kubernetes.io/projected/7042da3f-cd46-4647-bd40-7ef522099056-kube-api-access-tbrfc\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.687338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687128    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130b87d0-4259-4e0c-a4aa-3f89855a9993-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.687338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687137    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfh4m\" (UniqueName: \"kubernetes.io/projected/130b87d0-4259-4e0c-a4aa-3f89855a9993-kube-api-access-bfh4m\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:50.687338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:50.687144    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7042da3f-cd46-4647-bd40-7ef522099056-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:51.238290 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.238258    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7"
Jul 29 01:21:51.238740 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.238258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7" event={"ID":"130b87d0-4259-4e0c-a4aa-3f89855a9993","Type":"ContainerDied","Data":"5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8"}
Jul 29 01:21:51.238740 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.238374    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cb212bba3a175adfb249cecd2899900a91f50e11c6447230f9f4007018abbb8"
Jul 29 01:21:51.240256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.240237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt"
Jul 29 01:21:51.240371 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.240264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt" event={"ID":"7042da3f-cd46-4647-bd40-7ef522099056","Type":"ContainerDied","Data":"e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f"}
Jul 29 01:21:51.240371 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.240298    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e236d5de2c48685873cbbcf080dea399b3e7a4aabdf61253d1340a9b8cc4315f"
Jul 29 01:21:51.364288 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.364267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:51.392115 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.392078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc85m\" (UniqueName: \"kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m\") pod \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") "
Jul 29 01:21:51.392115 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.392117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util\") pod \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") "
Jul 29 01:21:51.392311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.392170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle\") pod \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\" (UID: \"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1\") "
Jul 29 01:21:51.392854 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.392823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle" (OuterVolumeSpecName: "bundle") pod "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" (UID: "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:51.394284 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.394257    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m" (OuterVolumeSpecName: "kube-api-access-tc85m") pod "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" (UID: "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1"). InnerVolumeSpecName "kube-api-access-tc85m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:51.400964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.400935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util" (OuterVolumeSpecName: "util") pod "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" (UID: "1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:21:51.492851 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.492759    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:51.492851 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.492800    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc85m\" (UniqueName: \"kubernetes.io/projected/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-kube-api-access-tc85m\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:51.492851 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:51.492810    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1-util\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:21:52.247272 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:52.247245    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz"
Jul 29 01:21:52.247673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:52.247247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz" event={"ID":"1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1","Type":"ContainerDied","Data":"964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c"}
Jul 29 01:21:52.247673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:52.247363    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="964317f5ea2be2cb76f4637685888c88f216282cba704e1c5929ae6f4bcc385c"
Jul 29 01:21:55.354935 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:55.354897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:55.355324 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:55.354962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:55.359658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:55.359636    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:56.272705 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:56.272679    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55c6cbb86c-2b4wd"
Jul 29 01:21:56.320280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:56.320250    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:21:56.427710 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:56.427672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:56.527670 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:56.527541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:56.587136 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:56.587102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:58.736296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:58.736265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:59.069597 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:21:59.069526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:01.647174 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647089    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"]
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647473    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="util"
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647486    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="util"
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647495    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="util"
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647501    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="util"
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647515    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="extract"
Jul 29 01:22:01.647527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647521    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647532    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="util"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647539    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="util"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647544    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647549    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647557    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647562    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647568    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647601    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647618    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647625    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="util"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647630    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="util"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647636    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647649    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="pull"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647660    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647664    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647721    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647726    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7042da3f-cd46-4647-bd40-7ef522099056" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647733    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05e307c-b575-48e1-9570-14554d5a0b6e" containerName="extract"
Jul 29 01:22:01.647739 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.647740    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="130b87d0-4259-4e0c-a4aa-3f89855a9993" containerName="extract"
Jul 29 01:22:01.652160 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.652146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:01.654987 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.654965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q7l9x\""
Jul 29 01:22:01.655138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.655121    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 01:22:01.664057 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.664036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"]
Jul 29 01:22:01.675236 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.675206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f7zq\" (UniqueName: \"kubernetes.io/projected/ac1766ac-9f31-47e7-ba8e-14ea559adfc5-kube-api-access-6f7zq\") pod \"dns-operator-controller-manager-864dd78c4c-9nkkn\" (UID: \"ac1766ac-9f31-47e7-ba8e-14ea559adfc5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:01.776105 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.776065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f7zq\" (UniqueName: \"kubernetes.io/projected/ac1766ac-9f31-47e7-ba8e-14ea559adfc5-kube-api-access-6f7zq\") pod \"dns-operator-controller-manager-864dd78c4c-9nkkn\" (UID: \"ac1766ac-9f31-47e7-ba8e-14ea559adfc5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:01.784223 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.784193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f7zq\" (UniqueName: \"kubernetes.io/projected/ac1766ac-9f31-47e7-ba8e-14ea559adfc5-kube-api-access-6f7zq\") pod \"dns-operator-controller-manager-864dd78c4c-9nkkn\" (UID: \"ac1766ac-9f31-47e7-ba8e-14ea559adfc5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:01.962461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:01.962369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:02.119268 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:02.119236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"]
Jul 29 01:22:02.123736 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:02.123706    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1766ac_9f31_47e7_ba8e_14ea559adfc5.slice/crio-cd5616e64f30e1f45c5087dfe73d57f5384ae1ea642a2a4e66986c17f07879af WatchSource:0}: Error finding container cd5616e64f30e1f45c5087dfe73d57f5384ae1ea642a2a4e66986c17f07879af: Status 404 returned error can't find the container with id cd5616e64f30e1f45c5087dfe73d57f5384ae1ea642a2a4e66986c17f07879af
Jul 29 01:22:02.300806 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:02.300771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn" event={"ID":"ac1766ac-9f31-47e7-ba8e-14ea559adfc5","Type":"ContainerStarted","Data":"cd5616e64f30e1f45c5087dfe73d57f5384ae1ea642a2a4e66986c17f07879af"}
Jul 29 01:22:03.220859 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:03.220818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:04.313818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:04.313782    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn" event={"ID":"ac1766ac-9f31-47e7-ba8e-14ea559adfc5","Type":"ContainerStarted","Data":"70a7bcf116e52e8f330447429e94aaf56836498da29c7ff98960cf92dd5f5a0a"}
Jul 29 01:22:04.314263 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:04.313907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:04.331718 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:04.331670    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn" podStartSLOduration=1.258704307 podStartE2EDuration="3.331655931s" totalImagesPullingTime="2.072951624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:04.329075362 +0000 UTC m=+714.358316275" watchObservedRunningTime="2026-07-29 01:22:04.331655931 +0000 UTC m=+714.360896908"
Jul 29 01:22:05.101511 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.101472    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"]
Jul 29 01:22:05.104968 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.104953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:05.107202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.107186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-64dj8\""
Jul 29 01:22:05.120287 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.120263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"]
Jul 29 01:22:05.209995 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.209959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7snq\" (UniqueName: \"kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq\") pod \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" (UID: \"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:05.310795 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.310758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7snq\" (UniqueName: \"kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq\") pod \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" (UID: \"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:05.322001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.321966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7snq\" (UniqueName: \"kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq\") pod \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" (UID: \"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:05.415674 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.415600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:05.554008 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.553985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"]
Jul 29 01:22:05.555588 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:05.555552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035ff6c7_ac9f_4e6d_b92c_c77a5306ea7e.slice/crio-9d833792df545bd9d778e6b0da5a3a087df0fb98c078c119e1fbc3090190f2d0 WatchSource:0}: Error finding container 9d833792df545bd9d778e6b0da5a3a087df0fb98c078c119e1fbc3090190f2d0: Status 404 returned error can't find the container with id 9d833792df545bd9d778e6b0da5a3a087df0fb98c078c119e1fbc3090190f2d0
Jul 29 01:22:05.612989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.612955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:05.856106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:05.856076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:06.328015 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:06.327969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx" event={"ID":"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e","Type":"ContainerStarted","Data":"9d833792df545bd9d778e6b0da5a3a087df0fb98c078c119e1fbc3090190f2d0"}
Jul 29 01:22:06.349289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:06.349206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:07.334728 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:07.334687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx" event={"ID":"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e","Type":"ContainerStarted","Data":"229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b"}
Jul 29 01:22:07.335168 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:07.334835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:07.352840 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:07.352791    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx" podStartSLOduration=0.918021839 podStartE2EDuration="2.352772846s" totalImagesPullingTime="1.434751007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:07.351125474 +0000 UTC m=+717.380366387" watchObservedRunningTime="2026-07-29 01:22:07.352772846 +0000 UTC m=+717.382013758"
Jul 29 01:22:09.085411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.085378    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"]
Jul 29 01:22:09.088890 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.088869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:09.092011 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.091995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k7hqf\""
Jul 29 01:22:09.101023 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.100994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"]
Jul 29 01:22:09.146005 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.145972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9g8x\" (UniqueName: \"kubernetes.io/projected/ade71b84-00e8-4ce2-b4ff-89a969572bc4-kube-api-access-d9g8x\") pod \"authorino-operator-75cc8d5cb7-v2wtn\" (UID: \"ade71b84-00e8-4ce2-b4ff-89a969572bc4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:09.247261 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.247223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9g8x\" (UniqueName: \"kubernetes.io/projected/ade71b84-00e8-4ce2-b4ff-89a969572bc4-kube-api-access-d9g8x\") pod \"authorino-operator-75cc8d5cb7-v2wtn\" (UID: \"ade71b84-00e8-4ce2-b4ff-89a969572bc4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:09.256230 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.256201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9g8x\" (UniqueName: \"kubernetes.io/projected/ade71b84-00e8-4ce2-b4ff-89a969572bc4-kube-api-access-d9g8x\") pod \"authorino-operator-75cc8d5cb7-v2wtn\" (UID: \"ade71b84-00e8-4ce2-b4ff-89a969572bc4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:09.399837 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.399750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:09.534252 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.534226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"]
Jul 29 01:22:09.536188 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:09.536165    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade71b84_00e8_4ce2_b4ff_89a969572bc4.slice/crio-5795d2dbf3b6dc12fa2b899dcbc1748e9b8ed243dad6b5c6c2635684809cdc88 WatchSource:0}: Error finding container 5795d2dbf3b6dc12fa2b899dcbc1748e9b8ed243dad6b5c6c2635684809cdc88: Status 404 returned error can't find the container with id 5795d2dbf3b6dc12fa2b899dcbc1748e9b8ed243dad6b5c6c2635684809cdc88
Jul 29 01:22:09.617949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:09.617916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:10.355553 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:10.355502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn" event={"ID":"ade71b84-00e8-4ce2-b4ff-89a969572bc4","Type":"ContainerStarted","Data":"5795d2dbf3b6dc12fa2b899dcbc1748e9b8ed243dad6b5c6c2635684809cdc88"}
Jul 29 01:22:10.652351 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:10.652271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:10.802524 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:10.802496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:12.368356 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:12.368322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn" event={"ID":"ade71b84-00e8-4ce2-b4ff-89a969572bc4","Type":"ContainerStarted","Data":"5a03683e85749dbe2933b2b6a5284a8b9862b06ca1787dfb2bc52e0100cfdd67"}
Jul 29 01:22:12.368774 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:12.368459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:12.385405 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:12.385349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn" podStartSLOduration=1.333261182 podStartE2EDuration="3.385334415s" totalImagesPullingTime="2.052073233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:12.384412408 +0000 UTC m=+722.413653333" watchObservedRunningTime="2026-07-29 01:22:12.385334415 +0000 UTC m=+722.414575327"
Jul 29 01:22:12.869075 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:12.869038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:13.873449 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.873417    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"]
Jul 29 01:22:13.876944 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.876928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:13.879234 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.879213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrxxz\""
Jul 29 01:22:13.892298 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.892275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"]
Jul 29 01:22:13.987709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.987676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:13.987908 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:13.987725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbn9b\" (UniqueName: \"kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.088990 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.088954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.089172 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.089008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbn9b\" (UniqueName: \"kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.089332 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.089311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.097569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.097535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbn9b\" (UniqueName: \"kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.187679 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.187549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:14.347513 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.347490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"]
Jul 29 01:22:14.349611 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:14.349542    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69fe3c8_ca1a_4a16_a587_455fc924d4b0.slice/crio-893f1f31e6dae25c233c50edc827aaf999a9fb43f5414dc31ef90012295ad73f WatchSource:0}: Error finding container 893f1f31e6dae25c233c50edc827aaf999a9fb43f5414dc31ef90012295ad73f: Status 404 returned error can't find the container with id 893f1f31e6dae25c233c50edc827aaf999a9fb43f5414dc31ef90012295ad73f
Jul 29 01:22:14.380005 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.379971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x" event={"ID":"e69fe3c8-ca1a-4a16-a587-455fc924d4b0","Type":"ContainerStarted","Data":"893f1f31e6dae25c233c50edc827aaf999a9fb43f5414dc31ef90012295ad73f"}
Jul 29 01:22:14.478972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:14.478883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:15.321003 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:15.320977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9nkkn"
Jul 29 01:22:15.849803 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:15.849765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:16.058773 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:16.058743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:18.345209 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:18.345175    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:19.420654 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:19.420615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x" event={"ID":"e69fe3c8-ca1a-4a16-a587-455fc924d4b0","Type":"ContainerStarted","Data":"f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3"}
Jul 29 01:22:19.421099 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:19.420697    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:19.441106 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:19.441064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x" podStartSLOduration=1.975040022 podStartE2EDuration="6.44105029s" totalImagesPullingTime="4.466010268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:19.438631984 +0000 UTC m=+729.467872947" watchObservedRunningTime="2026-07-29 01:22:19.44105029 +0000 UTC m=+729.470291203"
Jul 29 01:22:19.612767 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:19.612723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:19.715437 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:19.715361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:21.341408 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.341346    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dd9cd9f7b-d4w4b" podUID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" containerName="console" containerID="cri-o://640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261" gracePeriod=15
Jul 29 01:22:21.455860 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.455830    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"]
Jul 29 01:22:21.459253 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.459234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.462120 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.462097    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 01:22:21.462280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.462243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 01:22:21.462362 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.462318    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ls6zt\""
Jul 29 01:22:21.470096 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.470070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"]
Jul 29 01:22:21.474660 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.474631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:21.559480 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.559450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxq4r\" (UniqueName: \"kubernetes.io/projected/2951fb51-029c-4d3f-8550-2892b25a6898-kube-api-access-gxq4r\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.559673 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.559498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2951fb51-029c-4d3f-8550-2892b25a6898-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.559726 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.559684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2951fb51-029c-4d3f-8550-2892b25a6898-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.596459 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.596396    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:22:21.660054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660025    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660179    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr259\" (UniqueName: \"kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle\") pod \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\" (UID: \"d7dd8f14-6495-41bb-bec3-3c185f3ca043\") "
Jul 29 01:22:21.660563 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2951fb51-029c-4d3f-8550-2892b25a6898-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.660563 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxq4r\" (UniqueName: \"kubernetes.io/projected/2951fb51-029c-4d3f-8550-2892b25a6898-kube-api-access-gxq4r\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.660563 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2951fb51-029c-4d3f-8550-2892b25a6898-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.660744 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:22:21.660744 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660661    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config" (OuterVolumeSpecName: "console-config") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:22:21.660850 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660757    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:22:21.661020 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.660986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:22:21.661557 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.661528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2951fb51-029c-4d3f-8550-2892b25a6898-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.662452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.662434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:22:21.663063 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.663036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259" (OuterVolumeSpecName: "kube-api-access-zr259") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "kube-api-access-zr259". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:21.663063 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.663043    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7dd8f14-6495-41bb-bec3-3c185f3ca043" (UID: "d7dd8f14-6495-41bb-bec3-3c185f3ca043"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:22:21.663220 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.663205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2951fb51-029c-4d3f-8550-2892b25a6898-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.668515 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.668495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxq4r\" (UniqueName: \"kubernetes.io/projected/2951fb51-029c-4d3f-8550-2892b25a6898-kube-api-access-gxq4r\") pod \"kuadrant-console-plugin-66b5774985-h2fms\" (UID: \"2951fb51-029c-4d3f-8550-2892b25a6898\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.678979 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.678950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:21.761448 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761412    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761448 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761444    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761457    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-oauth-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761473    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-console-config\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761485    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr259\" (UniqueName: \"kubernetes.io/projected/d7dd8f14-6495-41bb-bec3-3c185f3ca043-kube-api-access-zr259\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761499    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-trusted-ca-bundle\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.761687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.761511    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7dd8f14-6495-41bb-bec3-3c185f3ca043-oauth-serving-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:21.770511 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.770489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"
Jul 29 01:22:21.908027 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:21.908004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms"]
Jul 29 01:22:21.909499 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:21.909477    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2951fb51_029c_4d3f_8550_2892b25a6898.slice/crio-a42a122689de2b2e250fe75573b1dac49963f380d07d0339c08cd389cc24cdf4 WatchSource:0}: Error finding container a42a122689de2b2e250fe75573b1dac49963f380d07d0339c08cd389cc24cdf4: Status 404 returned error can't find the container with id a42a122689de2b2e250fe75573b1dac49963f380d07d0339c08cd389cc24cdf4
Jul 29 01:22:22.439801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.439765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms" event={"ID":"2951fb51-029c-4d3f-8550-2892b25a6898","Type":"ContainerStarted","Data":"a42a122689de2b2e250fe75573b1dac49963f380d07d0339c08cd389cc24cdf4"}
Jul 29 01:22:22.441042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.441018    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" containerID="640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261" exitCode=0
Jul 29 01:22:22.441180 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.441067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9cd9f7b-d4w4b"
Jul 29 01:22:22.441180 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.441077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9cd9f7b-d4w4b" event={"ID":"d7dd8f14-6495-41bb-bec3-3c185f3ca043","Type":"ContainerDied","Data":"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"}
Jul 29 01:22:22.441180 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.441123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9cd9f7b-d4w4b" event={"ID":"d7dd8f14-6495-41bb-bec3-3c185f3ca043","Type":"ContainerDied","Data":"6920b2ee492c62b7a94bd1f40072ae2ebf0d342232728deedc7218981bd4594f"}
Jul 29 01:22:22.441180 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.441153    2578 scope.go:117] "RemoveContainer" containerID="640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"
Jul 29 01:22:22.450630 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.450611    2578 scope.go:117] "RemoveContainer" containerID="640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"
Jul 29 01:22:22.450896 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:22.450877    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261\": container with ID starting with 640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261 not found: ID does not exist" containerID="640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"
Jul 29 01:22:22.450941 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.450905    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261"} err="failed to get container status \"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261\": rpc error: code = NotFound desc = could not find container \"640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261\": container with ID starting with 640365b69ee70d89984b3f4fbc48ea1b9c98946eb2fd0788b3943975ee4d0261 not found: ID does not exist"
Jul 29 01:22:22.463751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.463720    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:22:22.473324 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:22.473299    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd9cd9f7b-d4w4b"]
Jul 29 01:22:23.376311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:23.376278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2wtn"
Jul 29 01:22:23.863672 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:23.863563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:23.956069 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:23.956034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:24.230505 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:24.230419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:24.329125 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:24.329085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:24.471138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:24.471103    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" path="/var/lib/kubelet/pods/d7dd8f14-6495-41bb-bec3-3c185f3ca043/volumes"
Jul 29 01:22:28.002645 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:28.002609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:28.103313 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:28.103269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:29.127198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:29.127147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:29.227716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:29.227683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:30.428759 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:30.428724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:31.412296 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.412265    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"]
Jul 29 01:22:31.412711 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.412695    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" containerName="console"
Jul 29 01:22:31.412711 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.412711    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" containerName="console"
Jul 29 01:22:31.412847 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.412803    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7dd8f14-6495-41bb-bec3-3c185f3ca043" containerName="console"
Jul 29 01:22:31.451238 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.451192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"]
Jul 29 01:22:31.451709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.451325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.555156 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.555119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjd4\" (UniqueName: \"kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.555350 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.555329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.656611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.656081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.656611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.656142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjd4\" (UniqueName: \"kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.656933 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.656904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.672353 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.672271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjd4\" (UniqueName: \"kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:31.763700 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:31.763664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:32.108127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.108087    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"]
Jul 29 01:22:32.117322 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.117297    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"]
Jul 29 01:22:32.130839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.130809    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"]
Jul 29 01:22:32.131049 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.131024    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" containerName="manager" containerID="cri-o://f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3" gracePeriod=2
Jul 29 01:22:32.138780 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.138754    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:22:32.154773 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:32.154726    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bs67x\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:32.159495 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.159446    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"]
Jul 29 01:22:32.159495 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.159496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:22:32.160206 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.159848    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"]
Jul 29 01:22:32.160206 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.159937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.160206 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.160051    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" containerName="manager" containerID="cri-o://229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b" gracePeriod=2
Jul 29 01:22:32.172126 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.172093    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"]
Jul 29 01:22:32.173334 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173308    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:32.173776 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173747    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" containerName="manager"
Jul 29 01:22:32.173776 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173770    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" containerName="manager"
Jul 29 01:22:32.173919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173783    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" containerName="manager"
Jul 29 01:22:32.173919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173792    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" containerName="manager"
Jul 29 01:22:32.173919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173888    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" containerName="manager"
Jul 29 01:22:32.173919 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.173901    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" containerName="manager"
Jul 29 01:22:32.178824 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.178802    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.184056 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:32.184030    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:32.209416 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.209260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:32.212926 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.212899    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"]
Jul 29 01:22:32.218814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.218787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:32.241809 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:32.241765    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:32.244147 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:32.244109    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:32.244704 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.244677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"]
Jul 29 01:22:32.260331 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.260306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw77k\" (UniqueName: \"kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.260471 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.260349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hmz\" (UniqueName: \"kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.260471 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.260379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.260562 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.260496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.361490 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw77k\" (UniqueName: \"kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.361490 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hmz\" (UniqueName: \"kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.361490 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.361804 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllmv\" (UniqueName: \"kubernetes.io/projected/d875e18a-b5d4-413a-bf85-6ef9ed14394d-kube-api-access-bllmv\") pod \"limitador-operator-controller-manager-859d7b78bd-7zv8h\" (UID: \"d875e18a-b5d4-413a-bf85-6ef9ed14394d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:32.361804 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.362000 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.362054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.361979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.374013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.373979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw77k\" (UniqueName: \"kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4hfqh\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.374013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.373998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hmz\" (UniqueName: \"kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbv5h\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.462628 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.462571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllmv\" (UniqueName: \"kubernetes.io/projected/d875e18a-b5d4-413a-bf85-6ef9ed14394d-kube-api-access-bllmv\") pod \"limitador-operator-controller-manager-859d7b78bd-7zv8h\" (UID: \"d875e18a-b5d4-413a-bf85-6ef9ed14394d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:32.471693 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.471665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllmv\" (UniqueName: \"kubernetes.io/projected/d875e18a-b5d4-413a-bf85-6ef9ed14394d-kube-api-access-bllmv\") pod \"limitador-operator-controller-manager-859d7b78bd-7zv8h\" (UID: \"d875e18a-b5d4-413a-bf85-6ef9ed14394d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:32.556029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.555993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:32.567322 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.567293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:32.573568 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:32.573538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:34.633359 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:34.633320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:34.741090 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:34.741054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:37.431700 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:37.431660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:37.534299 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:37.534265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:42.242720 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.242683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:42.340451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.340404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:42.416302 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.416274    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:42.418675 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.418620    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:42.447514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.447335    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:42.451708 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.451486    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:42.458905 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.458848    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:42.463471 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.463444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7snq\" (UniqueName: \"kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq\") pod \"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e\" (UID: \"035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e\") "
Jul 29 01:22:42.464536 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.464330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e69fe3c8-ca1a-4a16-a587-455fc924d4b0" (UID: "e69fe3c8-ca1a-4a16-a587-455fc924d4b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:42.465056 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.465034    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume\") pod \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") "
Jul 29 01:22:42.465169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.465090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbn9b\" (UniqueName: \"kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b\") pod \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\" (UID: \"e69fe3c8-ca1a-4a16-a587-455fc924d4b0\") "
Jul 29 01:22:42.465468 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.465413    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-extensions-socket-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:42.470719 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.470687    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b" (OuterVolumeSpecName: "kube-api-access-jbn9b") pod "e69fe3c8-ca1a-4a16-a587-455fc924d4b0" (UID: "e69fe3c8-ca1a-4a16-a587-455fc924d4b0"). InnerVolumeSpecName "kube-api-access-jbn9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:42.471139 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.471100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq" (OuterVolumeSpecName: "kube-api-access-m7snq") pod "035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" (UID: "035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e"). InnerVolumeSpecName "kube-api-access-m7snq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:42.487674 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.484530    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" path="/var/lib/kubelet/pods/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e/volumes"
Jul 29 01:22:42.487674 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.485153    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" path="/var/lib/kubelet/pods/e69fe3c8-ca1a-4a16-a587-455fc924d4b0/volumes"
Jul 29 01:22:42.566423 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.566364    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7snq\" (UniqueName: \"kubernetes.io/projected/035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e-kube-api-access-m7snq\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:42.566423 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.566422    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbn9b\" (UniqueName: \"kubernetes.io/projected/e69fe3c8-ca1a-4a16-a587-455fc924d4b0-kube-api-access-jbn9b\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:42.568836 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.568808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms" event={"ID":"2951fb51-029c-4d3f-8550-2892b25a6898","Type":"ContainerStarted","Data":"9e712067276b518adaca41b3e55745d3ef7536e86c761dd84063eedc95ec9756"}
Jul 29 01:22:42.569983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.569960    2578 generic.go:356] "Generic (PLEG): container finished" podID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" containerID="229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b" exitCode=0
Jul 29 01:22:42.570143 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.570013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:42.570143 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.570061    2578 scope.go:117] "RemoveContainer" containerID="229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b"
Jul 29 01:22:42.571404 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.571382    2578 generic.go:356] "Generic (PLEG): container finished" podID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" containerID="f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3" exitCode=0
Jul 29 01:22:42.571493 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.571417    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:42.578864 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.578848    2578 scope.go:117] "RemoveContainer" containerID="229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b"
Jul 29 01:22:42.579150 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.579125    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b\": container with ID starting with 229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b not found: ID does not exist" containerID="229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b"
Jul 29 01:22:42.579210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.579161    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b"} err="failed to get container status \"229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b\": rpc error: code = NotFound desc = could not find container \"229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b\": container with ID starting with 229b10b7b2c117c23b6af664cc55b85b1f405a6dcc76cc407d408c916023889b not found: ID does not exist"
Jul 29 01:22:42.579210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.579190    2578 scope.go:117] "RemoveContainer" containerID="f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3"
Jul 29 01:22:42.582776 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.582753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:42.587436 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.587419    2578 scope.go:117] "RemoveContainer" containerID="f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3"
Jul 29 01:22:42.587794 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.587777    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3\": container with ID starting with f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3 not found: ID does not exist" containerID="f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3"
Jul 29 01:22:42.587852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.587802    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3"} err="failed to get container status \"f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3\": rpc error: code = NotFound desc = could not find container \"f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3\": container with ID starting with f0c427ca8928294e01ca5508a484f27e52c880afaef0750d07571d7a2f34c9e3 not found: ID does not exist"
Jul 29 01:22:42.611167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.611140    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"]
Jul 29 01:22:42.622560 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:42.622536    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd875e18a_b5d4_413a_bf85_6ef9ed14394d.slice/crio-eb714523a21b42572b09e035982505c6c60e05c1c9124b1fce5041874d708b1d WatchSource:0}: Error finding container eb714523a21b42572b09e035982505c6c60e05c1c9124b1fce5041874d708b1d: Status 404 returned error can't find the container with id eb714523a21b42572b09e035982505c6c60e05c1c9124b1fce5041874d708b1d
Jul 29 01:22:42.623298 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:42.623282    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c40ef42_86ce_406b_82cc_7fa70d65b540.slice/crio-3fbedd33c08c71006164dc9fdd01a0c29c38aedf1ddcb06cd48c481288a0f920 WatchSource:0}: Error finding container 3fbedd33c08c71006164dc9fdd01a0c29c38aedf1ddcb06cd48c481288a0f920: Status 404 returned error can't find the container with id 3fbedd33c08c71006164dc9fdd01a0c29c38aedf1ddcb06cd48c481288a0f920
Jul 29 01:22:42.653508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.653475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:22:42.654757 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:42.654731    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d65c2b_361f_42d0_91bb_5321efbcffc8.slice/crio-ece1ba82c0fea2369d4c45585511518d34be18b64f078a73ffc5ffa392309225 WatchSource:0}: Error finding container ece1ba82c0fea2369d4c45585511518d34be18b64f078a73ffc5ffa392309225: Status 404 returned error can't find the container with id ece1ba82c0fea2369d4c45585511518d34be18b64f078a73ffc5ffa392309225
Jul 29 01:22:42.696710 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.696673    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:42.696863 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:42.696648    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h2fms" podStartSLOduration=1.19028051 podStartE2EDuration="21.696627079s" totalImagesPullingTime="20.506346569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:42.694029074 +0000 UTC m=+752.723269989" watchObservedRunningTime="2026-07-29 01:22:42.696627079 +0000 UTC m=+752.725868001"
Jul 29 01:22:42.715317 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:42.715278    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:43.578743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.578646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" event={"ID":"60d65c2b-361f-42d0-91bb-5321efbcffc8","Type":"ContainerStarted","Data":"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"}
Jul 29 01:22:43.578743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.578704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" event={"ID":"60d65c2b-361f-42d0-91bb-5321efbcffc8","Type":"ContainerStarted","Data":"ece1ba82c0fea2369d4c45585511518d34be18b64f078a73ffc5ffa392309225"}
Jul 29 01:22:43.578743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.578733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:43.580165 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.580137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" event={"ID":"5c40ef42-86ce-406b-82cc-7fa70d65b540","Type":"ContainerStarted","Data":"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"}
Jul 29 01:22:43.580278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.580189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" event={"ID":"5c40ef42-86ce-406b-82cc-7fa70d65b540","Type":"ContainerStarted","Data":"3fbedd33c08c71006164dc9fdd01a0c29c38aedf1ddcb06cd48c481288a0f920"}
Jul 29 01:22:43.580278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.580221    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:43.580557 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:43.580532    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:43.582527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.582506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h" event={"ID":"d875e18a-b5d4-413a-bf85-6ef9ed14394d","Type":"ContainerStarted","Data":"223c4ae645dc48adb9c0767ed1a9659d8bf2d2a0486b71a41e2bf30355c4a02b"}
Jul 29 01:22:43.582738 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.582545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h" event={"ID":"d875e18a-b5d4-413a-bf85-6ef9ed14394d","Type":"ContainerStarted","Data":"eb714523a21b42572b09e035982505c6c60e05c1c9124b1fce5041874d708b1d"}
Jul 29 01:22:43.582738 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.582726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:43.598313 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.598046    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" podStartSLOduration=11.598026062 podStartE2EDuration="11.598026062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:43.596195876 +0000 UTC m=+753.625436790" watchObservedRunningTime="2026-07-29 01:22:43.598026062 +0000 UTC m=+753.627266976"
Jul 29 01:22:43.598485 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:43.598391    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:43.600054 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:43.600017    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bs67x\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="e69fe3c8-ca1a-4a16-a587-455fc924d4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bs67x"
Jul 29 01:22:43.601498 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:43.601472    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7qlnx\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="035ff6c7-ac9f-4e6d-b92c-c77a5306ea7e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qlnx"
Jul 29 01:22:43.618070 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.618027    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" podStartSLOduration=11.61801371 podStartE2EDuration="11.61801371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:43.616558905 +0000 UTC m=+753.645799817" watchObservedRunningTime="2026-07-29 01:22:43.61801371 +0000 UTC m=+753.647254701"
Jul 29 01:22:43.633127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:43.633079    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h" podStartSLOduration=11.633065563 podStartE2EDuration="11.633065563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:43.631259961 +0000 UTC m=+753.660500873" watchObservedRunningTime="2026-07-29 01:22:43.633065563 +0000 UTC m=+753.662306475"
Jul 29 01:22:44.888481 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:44.888444    2578 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-ngq4w_kuadrant-system_9ec8f773-92d8-4f89-859f-e4ed8a86ca30_0(4dac58321afe0108b9755942947739b99538869cc12bbafd73304233f775fc15): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-ngq4w to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 29 01:22:44.888776 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:44.888509    2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-ngq4w_kuadrant-system_9ec8f773-92d8-4f89-859f-e4ed8a86ca30_0(4dac58321afe0108b9755942947739b99538869cc12bbafd73304233f775fc15): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-ngq4w to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:45.594163 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.594132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:45.596389 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:45.596357    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="9ec8f773-92d8-4f89-859f-e4ed8a86ca30" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:45.606057 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.606037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:45.608072 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:45.608048    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="9ec8f773-92d8-4f89-859f-e4ed8a86ca30" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:45.689894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.689859    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwjd4\" (UniqueName: \"kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4\") pod \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") "
Jul 29 01:22:45.690039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.689920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume\") pod \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\" (UID: \"9ec8f773-92d8-4f89-859f-e4ed8a86ca30\") "
Jul 29 01:22:45.690211 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.690187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9ec8f773-92d8-4f89-859f-e4ed8a86ca30" (UID: "9ec8f773-92d8-4f89-859f-e4ed8a86ca30"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:45.692137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.692117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4" (OuterVolumeSpecName: "kube-api-access-rwjd4") pod "9ec8f773-92d8-4f89-859f-e4ed8a86ca30" (UID: "9ec8f773-92d8-4f89-859f-e4ed8a86ca30"). InnerVolumeSpecName "kube-api-access-rwjd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:45.790694 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.790662    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwjd4\" (UniqueName: \"kubernetes.io/projected/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-kube-api-access-rwjd4\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:45.790694 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.790689    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec8f773-92d8-4f89-859f-e4ed8a86ca30-extensions-socket-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:45.818101 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.818069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:45.892354 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:45.892270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:46.470504 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:46.470463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec8f773-92d8-4f89-859f-e4ed8a86ca30" path="/var/lib/kubelet/pods/9ec8f773-92d8-4f89-859f-e4ed8a86ca30/volumes"
Jul 29 01:22:46.599985 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:46.599953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:46.601999 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:46.601965    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="9ec8f773-92d8-4f89-859f-e4ed8a86ca30" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:46.603603 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:46.603558    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ngq4w\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="9ec8f773-92d8-4f89-859f-e4ed8a86ca30" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ngq4w"
Jul 29 01:22:52.428167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:52.428090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:52.528325 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:52.528294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:54.590277 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.590246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:54.590679 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.590318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:22:54.590679 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.590461    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zv8h"
Jul 29 01:22:54.670560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.670531    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:54.670794 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.670766    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" podUID="5c40ef42-86ce-406b-82cc-7fa70d65b540" containerName="manager" containerID="cri-o://49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803" gracePeriod=10
Jul 29 01:22:54.928456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.928430    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:54.966547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.966522    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7hmz\" (UniqueName: \"kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz\") pod \"5c40ef42-86ce-406b-82cc-7fa70d65b540\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") "
Jul 29 01:22:54.966733 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.966616    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume\") pod \"5c40ef42-86ce-406b-82cc-7fa70d65b540\" (UID: \"5c40ef42-86ce-406b-82cc-7fa70d65b540\") "
Jul 29 01:22:54.967019 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.966997    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c40ef42-86ce-406b-82cc-7fa70d65b540" (UID: "5c40ef42-86ce-406b-82cc-7fa70d65b540"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:54.969436 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.969382    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz" (OuterVolumeSpecName: "kube-api-access-g7hmz") pod "5c40ef42-86ce-406b-82cc-7fa70d65b540" (UID: "5c40ef42-86ce-406b-82cc-7fa70d65b540"). InnerVolumeSpecName "kube-api-access-g7hmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:54.971976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.971947    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:22:54.972504 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.972487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c40ef42-86ce-406b-82cc-7fa70d65b540" containerName="manager"
Jul 29 01:22:54.972594 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.972509    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c40ef42-86ce-406b-82cc-7fa70d65b540" containerName="manager"
Jul 29 01:22:54.972656 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.972644    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c40ef42-86ce-406b-82cc-7fa70d65b540" containerName="manager"
Jul 29 01:22:54.975823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.975801    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:54.994451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:54.994422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:22:55.068004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.067965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.068004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.068009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjccx\" (UniqueName: \"kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.068252 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.068138    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40ef42-86ce-406b-82cc-7fa70d65b540-extensions-socket-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:55.068252 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.068163    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7hmz\" (UniqueName: \"kubernetes.io/projected/5c40ef42-86ce-406b-82cc-7fa70d65b540-kube-api-access-g7hmz\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:22:55.169200 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.169118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.169200 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.169161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjccx\" (UniqueName: \"kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.169499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.169478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.178139 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.178109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjccx\" (UniqueName: \"kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx\") pod \"kuadrant-operator-controller-manager-86878c769f-2q9df\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.287493 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.287456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.438696 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.438616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:22:55.445401 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:22:55.445375    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c60a50_7abe_4a89_8453_4e64e09af1d2.slice/crio-aadcf9fb58cf8f0fbc6c5cc875af42ed2e9984746bb7cb593844eeeeb47114d1 WatchSource:0}: Error finding container aadcf9fb58cf8f0fbc6c5cc875af42ed2e9984746bb7cb593844eeeeb47114d1: Status 404 returned error can't find the container with id aadcf9fb58cf8f0fbc6c5cc875af42ed2e9984746bb7cb593844eeeeb47114d1
Jul 29 01:22:55.648682 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.648647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:55.654025 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.653996    2578 generic.go:356] "Generic (PLEG): container finished" podID="5c40ef42-86ce-406b-82cc-7fa70d65b540" containerID="49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803" exitCode=0
Jul 29 01:22:55.654196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.654063    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"
Jul 29 01:22:55.654196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.654082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" event={"ID":"5c40ef42-86ce-406b-82cc-7fa70d65b540","Type":"ContainerDied","Data":"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"}
Jul 29 01:22:55.654196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.654141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h" event={"ID":"5c40ef42-86ce-406b-82cc-7fa70d65b540","Type":"ContainerDied","Data":"3fbedd33c08c71006164dc9fdd01a0c29c38aedf1ddcb06cd48c481288a0f920"}
Jul 29 01:22:55.654196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.654171    2578 scope.go:117] "RemoveContainer" containerID="49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"
Jul 29 01:22:55.655853 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.655832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" event={"ID":"09c60a50-7abe-4a89-8453-4e64e09af1d2","Type":"ContainerStarted","Data":"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"}
Jul 29 01:22:55.655975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.655879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" event={"ID":"09c60a50-7abe-4a89-8453-4e64e09af1d2","Type":"ContainerStarted","Data":"aadcf9fb58cf8f0fbc6c5cc875af42ed2e9984746bb7cb593844eeeeb47114d1"}
Jul 29 01:22:55.655975 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.655920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:22:55.665311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.665295    2578 scope.go:117] "RemoveContainer" containerID="49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"
Jul 29 01:22:55.665633 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:22:55.665615    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803\": container with ID starting with 49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803 not found: ID does not exist" containerID="49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"
Jul 29 01:22:55.665681 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.665644    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803"} err="failed to get container status \"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803\": rpc error: code = NotFound desc = could not find container \"49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803\": container with ID starting with 49a847bec5d77904d4d6078eaeead29786a61607ea1a3853dc9cf3f1ee39c803 not found: ID does not exist"
Jul 29 01:22:55.701519 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.701426    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" podStartSLOduration=1.7014104190000001 podStartE2EDuration="1.701410419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:55.7002105 +0000 UTC m=+765.729451414" watchObservedRunningTime="2026-07-29 01:22:55.701410419 +0000 UTC m=+765.730651333"
Jul 29 01:22:55.732146 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.732118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:55.748432 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.748405    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbv5h"]
Jul 29 01:22:55.814825 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:55.814797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:56.470598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:22:56.470555    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c40ef42-86ce-406b-82cc-7fa70d65b540" path="/var/lib/kubelet/pods/5c40ef42-86ce-406b-82cc-7fa70d65b540/volumes"
Jul 29 01:23:00.238766 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:00.238732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:00.338946 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:00.338914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:00.439162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:00.439129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:00.539068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:00.539034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:05.619689 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:05.619645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:05.719959 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:05.719929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:06.664745 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:06.664719    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:23:06.715789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:06.715751    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:23:06.716019 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:06.715969    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" podUID="60d65c2b-361f-42d0-91bb-5321efbcffc8" containerName="manager" containerID="cri-o://33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5" gracePeriod=10
Jul 29 01:23:07.538348 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.538323    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:23:07.682387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.682310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume\") pod \"60d65c2b-361f-42d0-91bb-5321efbcffc8\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") "
Jul 29 01:23:07.682772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.682463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw77k\" (UniqueName: \"kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k\") pod \"60d65c2b-361f-42d0-91bb-5321efbcffc8\" (UID: \"60d65c2b-361f-42d0-91bb-5321efbcffc8\") "
Jul 29 01:23:07.682772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.682714    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "60d65c2b-361f-42d0-91bb-5321efbcffc8" (UID: "60d65c2b-361f-42d0-91bb-5321efbcffc8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:23:07.684798 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.684771    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k" (OuterVolumeSpecName: "kube-api-access-zw77k") pod "60d65c2b-361f-42d0-91bb-5321efbcffc8" (UID: "60d65c2b-361f-42d0-91bb-5321efbcffc8"). InnerVolumeSpecName "kube-api-access-zw77k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:23:07.730596 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.730543    2578 generic.go:356] "Generic (PLEG): container finished" podID="60d65c2b-361f-42d0-91bb-5321efbcffc8" containerID="33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5" exitCode=0
Jul 29 01:23:07.730755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.730611    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"
Jul 29 01:23:07.730755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.730633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" event={"ID":"60d65c2b-361f-42d0-91bb-5321efbcffc8","Type":"ContainerDied","Data":"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"}
Jul 29 01:23:07.730755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.730691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh" event={"ID":"60d65c2b-361f-42d0-91bb-5321efbcffc8","Type":"ContainerDied","Data":"ece1ba82c0fea2369d4c45585511518d34be18b64f078a73ffc5ffa392309225"}
Jul 29 01:23:07.730755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.730717    2578 scope.go:117] "RemoveContainer" containerID="33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"
Jul 29 01:23:07.740331 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.740314    2578 scope.go:117] "RemoveContainer" containerID="33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"
Jul 29 01:23:07.740624 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:23:07.740604    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5\": container with ID starting with 33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5 not found: ID does not exist" containerID="33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"
Jul 29 01:23:07.740698 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.740632    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5"} err="failed to get container status \"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5\": rpc error: code = NotFound desc = could not find container \"33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5\": container with ID starting with 33c6ba2c53773d6344f754fbe5ac5853e8a4e7ff15389a82f39fc6b125bae9a5 not found: ID does not exist"
Jul 29 01:23:07.782792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.782764    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:23:07.783118 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.783099    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60d65c2b-361f-42d0-91bb-5321efbcffc8-extensions-socket-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:07.783167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.783121    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw77k\" (UniqueName: \"kubernetes.io/projected/60d65c2b-361f-42d0-91bb-5321efbcffc8-kube-api-access-zw77k\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:07.787548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:07.787524    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4hfqh"]
Jul 29 01:23:08.470373 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:08.470340    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d65c2b-361f-42d0-91bb-5321efbcffc8" path="/var/lib/kubelet/pods/60d65c2b-361f-42d0-91bb-5321efbcffc8/volumes"
Jul 29 01:23:11.034658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:11.034628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:11.494560 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:11.494472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:25.251835 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.251801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:25.252368 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.252348    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d65c2b-361f-42d0-91bb-5321efbcffc8" containerName="manager"
Jul 29 01:23:25.252450 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.252372    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d65c2b-361f-42d0-91bb-5321efbcffc8" containerName="manager"
Jul 29 01:23:25.252508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.252490    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d65c2b-361f-42d0-91bb-5321efbcffc8" containerName="manager"
Jul 29 01:23:25.254779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.254749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:25.327922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.327888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:25.328113 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.327992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.330377 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.330354    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 01:23:25.364768 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.364733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:25.367677 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.367652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:25.427911 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.427880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:25.450022 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.449987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqtk\" (UniqueName: \"kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.450159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.450031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.550921 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.550835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqtk\" (UniqueName: \"kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.550921 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.550881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.551439 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.551422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.565105 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.565079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqtk\" (UniqueName: \"kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk\") pod \"limitador-limitador-64c94fd64f-9l554\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.641887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.641854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:25.781797 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.781768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:25.784225 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:23:25.784189    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3ce3ab_5254_42ec_a313_96c3d2d82849.slice/crio-8eecc386fe8f260824a756840aa9217a41cf1f7b95dbd4726188edf1dec4aa29 WatchSource:0}: Error finding container 8eecc386fe8f260824a756840aa9217a41cf1f7b95dbd4726188edf1dec4aa29: Status 404 returned error can't find the container with id 8eecc386fe8f260824a756840aa9217a41cf1f7b95dbd4726188edf1dec4aa29
Jul 29 01:23:25.834386 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:25.834296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" event={"ID":"5e3ce3ab-5254-42ec-a313-96c3d2d82849","Type":"ContainerStarted","Data":"8eecc386fe8f260824a756840aa9217a41cf1f7b95dbd4726188edf1dec4aa29"}
Jul 29 01:23:26.060931 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.060898    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:26.065844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.065823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:26.067830 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.067811    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bbhsp\""
Jul 29 01:23:26.071187 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.071161    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:26.089764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.089690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:26.160720 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.160693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:26.256417 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.256385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf9bd\" (UniqueName: \"kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd\") pod \"authorino-58cd955675-7kkkj\" (UID: \"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae\") " pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:26.357243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.357166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf9bd\" (UniqueName: \"kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd\") pod \"authorino-58cd955675-7kkkj\" (UID: \"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae\") " pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:26.365219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.365194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf9bd\" (UniqueName: \"kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd\") pod \"authorino-58cd955675-7kkkj\" (UID: \"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae\") " pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:26.377011 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.376985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:26.531099 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.531031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:26.841697 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:26.841666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kkkj" event={"ID":"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae","Type":"ContainerStarted","Data":"65e1731bd1d718505a81ebf21ada7a8e2ec5ae67a82f7e5bc790cb984e17563e"}
Jul 29 01:23:30.619440 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.619358    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:30.865042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.865006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kkkj" event={"ID":"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae","Type":"ContainerStarted","Data":"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"}
Jul 29 01:23:30.866561 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.866537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" event={"ID":"5e3ce3ab-5254-42ec-a313-96c3d2d82849","Type":"ContainerStarted","Data":"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"}
Jul 29 01:23:30.866707 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.866641    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:30.881476 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.881377    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7kkkj" podStartSLOduration=1.097304774 podStartE2EDuration="4.881360838s" totalImagesPullingTime="3.784056064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:30.880151772 +0000 UTC m=+800.909392684" watchObservedRunningTime="2026-07-29 01:23:30.881360838 +0000 UTC m=+800.910601751"
Jul 29 01:23:30.895894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:30.895844    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" podStartSLOduration=1.361281236 podStartE2EDuration="5.89582812s" totalImagesPullingTime="4.534546884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:30.894796212 +0000 UTC m=+800.924037126" watchObservedRunningTime="2026-07-29 01:23:30.89582812 +0000 UTC m=+800.925069032"
Jul 29 01:23:31.873028 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:31.872976    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7kkkj" podUID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" containerName="authorino" containerID="cri-o://6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823" gracePeriod=30
Jul 29 01:23:32.119378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.119356    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:32.201642 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.201518    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf9bd\" (UniqueName: \"kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd\") pod \"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae\" (UID: \"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae\") "
Jul 29 01:23:32.203737 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.203705    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd" (OuterVolumeSpecName: "kube-api-access-vf9bd") pod "0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" (UID: "0b114b89-8dd2-4c6c-b1bc-c255cad4fbae"). InnerVolumeSpecName "kube-api-access-vf9bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:23:32.302473 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.302440    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf9bd\" (UniqueName: \"kubernetes.io/projected/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae-kube-api-access-vf9bd\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:32.879834 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.879799    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" containerID="6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823" exitCode=0
Jul 29 01:23:32.880274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.879846    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kkkj"
Jul 29 01:23:32.880274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.879887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kkkj" event={"ID":"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae","Type":"ContainerDied","Data":"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"}
Jul 29 01:23:32.880274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.879929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kkkj" event={"ID":"0b114b89-8dd2-4c6c-b1bc-c255cad4fbae","Type":"ContainerDied","Data":"65e1731bd1d718505a81ebf21ada7a8e2ec5ae67a82f7e5bc790cb984e17563e"}
Jul 29 01:23:32.880274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.879946    2578 scope.go:117] "RemoveContainer" containerID="6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"
Jul 29 01:23:32.889010 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.888991    2578 scope.go:117] "RemoveContainer" containerID="6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"
Jul 29 01:23:32.889307 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:23:32.889289    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823\": container with ID starting with 6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823 not found: ID does not exist" containerID="6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"
Jul 29 01:23:32.889346 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.889321    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823"} err="failed to get container status \"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823\": rpc error: code = NotFound desc = could not find container \"6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823\": container with ID starting with 6891eaffc692317fe36039079862e45a7d51d591f3984ada2cf25a0e50123823 not found: ID does not exist"
Jul 29 01:23:32.894979 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.894954    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:32.898520 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:32.898500    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kkkj"]
Jul 29 01:23:34.470314 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:34.470274    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" path="/var/lib/kubelet/pods/0b114b89-8dd2-4c6c-b1bc-c255cad4fbae/volumes"
Jul 29 01:23:41.615874 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:41.615813    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:41.616515 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:41.616070    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" podUID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" containerName="limitador" containerID="cri-o://6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1" gracePeriod=30
Jul 29 01:23:41.616937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:41.616763    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:42.176508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.176443    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:42.273857 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.273826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnqtk\" (UniqueName: \"kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk\") pod \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") "
Jul 29 01:23:42.274037 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.273907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file\") pod \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\" (UID: \"5e3ce3ab-5254-42ec-a313-96c3d2d82849\") "
Jul 29 01:23:42.274282 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.274259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file" (OuterVolumeSpecName: "config-file") pod "5e3ce3ab-5254-42ec-a313-96c3d2d82849" (UID: "5e3ce3ab-5254-42ec-a313-96c3d2d82849"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:23:42.276081 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.276058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk" (OuterVolumeSpecName: "kube-api-access-tnqtk") pod "5e3ce3ab-5254-42ec-a313-96c3d2d82849" (UID: "5e3ce3ab-5254-42ec-a313-96c3d2d82849"). InnerVolumeSpecName "kube-api-access-tnqtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:23:42.374650 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.374621    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e3ce3ab-5254-42ec-a313-96c3d2d82849-config-file\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:42.374650 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.374647    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnqtk\" (UniqueName: \"kubernetes.io/projected/5e3ce3ab-5254-42ec-a313-96c3d2d82849-kube-api-access-tnqtk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:42.935856 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.935809    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" containerID="6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1" exitCode=0
Jul 29 01:23:42.936285 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.935873    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554"
Jul 29 01:23:42.936285 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.935897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" event={"ID":"5e3ce3ab-5254-42ec-a313-96c3d2d82849","Type":"ContainerDied","Data":"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"}
Jul 29 01:23:42.936285 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.935969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9l554" event={"ID":"5e3ce3ab-5254-42ec-a313-96c3d2d82849","Type":"ContainerDied","Data":"8eecc386fe8f260824a756840aa9217a41cf1f7b95dbd4726188edf1dec4aa29"}
Jul 29 01:23:42.936285 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.935991    2578 scope.go:117] "RemoveContainer" containerID="6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"
Jul 29 01:23:42.945184 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.945165    2578 scope.go:117] "RemoveContainer" containerID="6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"
Jul 29 01:23:42.945454 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:23:42.945436    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1\": container with ID starting with 6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1 not found: ID does not exist" containerID="6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"
Jul 29 01:23:42.945499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.945464    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1"} err="failed to get container status \"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1\": rpc error: code = NotFound desc = could not find container \"6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1\": container with ID starting with 6d3f80717f0abdaeeabde36fb52a5181043c56bc4137073e5b83c184d589d3c1 not found: ID does not exist"
Jul 29 01:23:42.952198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.952176    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:42.956334 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:42.956311    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9l554"]
Jul 29 01:23:44.231503 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.231461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:44.331340 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.331302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:44.470751 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.470723    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" path="/var/lib/kubelet/pods/5e3ce3ab-5254-42ec-a313-96c3d2d82849/volumes"
Jul 29 01:23:44.713249 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.713207    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"]
Jul 29 01:23:44.714199 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714174    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" containerName="limitador"
Jul 29 01:23:44.714199 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714201    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" containerName="limitador"
Jul 29 01:23:44.714339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714211    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" containerName="authorino"
Jul 29 01:23:44.714339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714220    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" containerName="authorino"
Jul 29 01:23:44.714339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714317    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3ce3ab-5254-42ec-a313-96c3d2d82849" containerName="limitador"
Jul 29 01:23:44.714339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.714331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b114b89-8dd2-4c6c-b1bc-c255cad4fbae" containerName="authorino"
Jul 29 01:23:44.718898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.718879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.721218 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.721187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 29 01:23:44.722027 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.721995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zdzxs\""
Jul 29 01:23:44.722171 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.722026    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:23:44.722277 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.722263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:23:44.725403 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.725380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"]
Jul 29 01:23:44.743417 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.743382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:44.800457 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.800430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj29f\" (UniqueName: \"kubernetes.io/projected/a4d603cd-3606-4c95-910a-54fdf26183ae-kube-api-access-tj29f\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.800457 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.800460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a4d603cd-3606-4c95-910a-54fdf26183ae-data\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.901281 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.901246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj29f\" (UniqueName: \"kubernetes.io/projected/a4d603cd-3606-4c95-910a-54fdf26183ae-kube-api-access-tj29f\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.901281 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.901281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a4d603cd-3606-4c95-910a-54fdf26183ae-data\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.901703 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.901687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a4d603cd-3606-4c95-910a-54fdf26183ae-data\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:44.912304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:44.912277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj29f\" (UniqueName: \"kubernetes.io/projected/a4d603cd-3606-4c95-910a-54fdf26183ae-kube-api-access-tj29f\") pod \"postgres-69fb4594cf-xq8kn\" (UID: \"a4d603cd-3606-4c95-910a-54fdf26183ae\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:45.032295 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:45.032261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:45.167508 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:45.167483    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"]
Jul 29 01:23:45.169639 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:23:45.169610    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d603cd_3606_4c95_910a_54fdf26183ae.slice/crio-2caf9afd308daf98946146d591ddd9e182aebefb94cbcc1ce123447e88d79595 WatchSource:0}: Error finding container 2caf9afd308daf98946146d591ddd9e182aebefb94cbcc1ce123447e88d79595: Status 404 returned error can't find the container with id 2caf9afd308daf98946146d591ddd9e182aebefb94cbcc1ce123447e88d79595
Jul 29 01:23:45.953330 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:45.953294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn" event={"ID":"a4d603cd-3606-4c95-910a-54fdf26183ae","Type":"ContainerStarted","Data":"2caf9afd308daf98946146d591ddd9e182aebefb94cbcc1ce123447e88d79595"}
Jul 29 01:23:50.994176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:50.994134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn" event={"ID":"a4d603cd-3606-4c95-910a-54fdf26183ae","Type":"ContainerStarted","Data":"660807a863e78d54061b0b28ba4282c96c2f137a0053c7a8640a9e82ecd8ccfa"}
Jul 29 01:23:50.994644 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:50.994194    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:51.011045 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:51.010993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn" podStartSLOduration=1.73450235 podStartE2EDuration="7.010977143s" totalImagesPullingTime="5.276474793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:51.008812877 +0000 UTC m=+821.038053791" watchObservedRunningTime="2026-07-29 01:23:51.010977143 +0000 UTC m=+821.040218056"
Jul 29 01:23:57.029764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.029730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xq8kn"
Jul 29 01:23:57.338479 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.338400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:57.558799 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.558760    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:23:57.565018 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.564997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:57.567672 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.567638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bbhsp\""
Jul 29 01:23:57.569468 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.569444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:23:57.613539 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.613447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59459\" (UniqueName: \"kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459\") pod \"authorino-5d4b67c446-gczz7\" (UID: \"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea\") " pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:57.714244 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.714206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59459\" (UniqueName: \"kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459\") pod \"authorino-5d4b67c446-gczz7\" (UID: \"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea\") " pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:57.722377 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.722340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59459\" (UniqueName: \"kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459\") pod \"authorino-5d4b67c446-gczz7\" (UID: \"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea\") " pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:57.796257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.796218    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:23:57.796499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.796487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:57.813076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.813046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:57.820064 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.820032    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:23:57.825280 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.825256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:57.830251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.830227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:23:57.916189 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.916155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngx7\" (UniqueName: \"kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7\") pod \"authorino-77d69bfb9-lgg8n\" (UID: \"7ad020f3-90c0-4de8-a520-4ab96384e243\") " pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:57.936967 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:57.936935    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:23:57.939061 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:23:57.939039    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb84c4ad_040d_45e4_8a60_3f2b1e3e44ea.slice/crio-fbb49c405770cad3adc46fc80b1efc138bb19e8fa9344c2887da345aa8af780d WatchSource:0}: Error finding container fbb49c405770cad3adc46fc80b1efc138bb19e8fa9344c2887da345aa8af780d: Status 404 returned error can't find the container with id fbb49c405770cad3adc46fc80b1efc138bb19e8fa9344c2887da345aa8af780d
Jul 29 01:23:58.017008 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.016971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngx7\" (UniqueName: \"kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7\") pod \"authorino-77d69bfb9-lgg8n\" (UID: \"7ad020f3-90c0-4de8-a520-4ab96384e243\") " pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:58.024954 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.024923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngx7\" (UniqueName: \"kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7\") pod \"authorino-77d69bfb9-lgg8n\" (UID: \"7ad020f3-90c0-4de8-a520-4ab96384e243\") " pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:58.033800 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.033771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gczz7" event={"ID":"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea","Type":"ContainerStarted","Data":"fbb49c405770cad3adc46fc80b1efc138bb19e8fa9344c2887da345aa8af780d"}
Jul 29 01:23:58.077214 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.077175    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:23:58.077441 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.077430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:58.218244 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:58.218212    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:23:58.219877 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:23:58.219850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ad020f3_90c0_4de8_a520_4ab96384e243.slice/crio-3a8d5a00c4761c638130d3109883fd4d311b5a8b457582dd4009b4905721a884 WatchSource:0}: Error finding container 3a8d5a00c4761c638130d3109883fd4d311b5a8b457582dd4009b4905721a884: Status 404 returned error can't find the container with id 3a8d5a00c4761c638130d3109883fd4d311b5a8b457582dd4009b4905721a884
Jul 29 01:23:59.041050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.041012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" event={"ID":"7ad020f3-90c0-4de8-a520-4ab96384e243","Type":"ContainerStarted","Data":"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"}
Jul 29 01:23:59.041050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.041026    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" podUID="7ad020f3-90c0-4de8-a520-4ab96384e243" containerName="authorino" containerID="cri-o://004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd" gracePeriod=30
Jul 29 01:23:59.041050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.041058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" event={"ID":"7ad020f3-90c0-4de8-a520-4ab96384e243","Type":"ContainerStarted","Data":"3a8d5a00c4761c638130d3109883fd4d311b5a8b457582dd4009b4905721a884"}
Jul 29 01:23:59.042781 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.042762    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gczz7" event={"ID":"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea","Type":"ContainerStarted","Data":"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"}
Jul 29 01:23:59.042870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.042830    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-gczz7" podUID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" containerName="authorino" containerID="cri-o://d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df" gracePeriod=30
Jul 29 01:23:59.056178 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.056128    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" podStartSLOduration=1.696321115 podStartE2EDuration="2.056110208s" totalImagesPullingTime="359.789093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:59.055792556 +0000 UTC m=+829.085033488" watchObservedRunningTime="2026-07-29 01:23:59.056110208 +0000 UTC m=+829.085351124"
Jul 29 01:23:59.071153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.071094    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-gczz7" podStartSLOduration=1.745491634 podStartE2EDuration="2.071075721s" totalImagesPullingTime="325.584087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:59.070659919 +0000 UTC m=+829.099900846" watchObservedRunningTime="2026-07-29 01:23:59.071075721 +0000 UTC m=+829.100316637"
Jul 29 01:23:59.315140 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.315115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:23:59.317597 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.317561    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:23:59.432008 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.431975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59459\" (UniqueName: \"kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459\") pod \"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea\" (UID: \"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea\") "
Jul 29 01:23:59.432317 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.432042    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sngx7\" (UniqueName: \"kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7\") pod \"7ad020f3-90c0-4de8-a520-4ab96384e243\" (UID: \"7ad020f3-90c0-4de8-a520-4ab96384e243\") "
Jul 29 01:23:59.434147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.434118    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459" (OuterVolumeSpecName: "kube-api-access-59459") pod "db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" (UID: "db84c4ad-040d-45e4-8a60-3f2b1e3e44ea"). InnerVolumeSpecName "kube-api-access-59459". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:23:59.434235 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.434214    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7" (OuterVolumeSpecName: "kube-api-access-sngx7") pod "7ad020f3-90c0-4de8-a520-4ab96384e243" (UID: "7ad020f3-90c0-4de8-a520-4ab96384e243"). InnerVolumeSpecName "kube-api-access-sngx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:23:59.532866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.532828    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sngx7\" (UniqueName: \"kubernetes.io/projected/7ad020f3-90c0-4de8-a520-4ab96384e243-kube-api-access-sngx7\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:23:59.532866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:23:59.532859    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59459\" (UniqueName: \"kubernetes.io/projected/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea-kube-api-access-59459\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:24:00.049770 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.049734    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ad020f3-90c0-4de8-a520-4ab96384e243" containerID="004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd" exitCode=0
Jul 29 01:24:00.050240 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.049780    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d69bfb9-lgg8n"
Jul 29 01:24:00.050240 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.049821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" event={"ID":"7ad020f3-90c0-4de8-a520-4ab96384e243","Type":"ContainerDied","Data":"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"}
Jul 29 01:24:00.050240 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.049867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d69bfb9-lgg8n" event={"ID":"7ad020f3-90c0-4de8-a520-4ab96384e243","Type":"ContainerDied","Data":"3a8d5a00c4761c638130d3109883fd4d311b5a8b457582dd4009b4905721a884"}
Jul 29 01:24:00.050240 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.049884    2578 scope.go:117] "RemoveContainer" containerID="004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"
Jul 29 01:24:00.051323 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.051299    2578 generic.go:356] "Generic (PLEG): container finished" podID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" containerID="d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df" exitCode=0
Jul 29 01:24:00.051415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.051332    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gczz7"
Jul 29 01:24:00.051415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.051339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gczz7" event={"ID":"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea","Type":"ContainerDied","Data":"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"}
Jul 29 01:24:00.051415 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.051370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gczz7" event={"ID":"db84c4ad-040d-45e4-8a60-3f2b1e3e44ea","Type":"ContainerDied","Data":"fbb49c405770cad3adc46fc80b1efc138bb19e8fa9344c2887da345aa8af780d"}
Jul 29 01:24:00.059766 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.059749    2578 scope.go:117] "RemoveContainer" containerID="004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"
Jul 29 01:24:00.060063 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:24:00.060038    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd\": container with ID starting with 004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd not found: ID does not exist" containerID="004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"
Jul 29 01:24:00.060167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.060073    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd"} err="failed to get container status \"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd\": rpc error: code = NotFound desc = could not find container \"004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd\": container with ID starting with 004f59c9f8cf37c7e49dc7a6351c61d01bb14ca71539defced2c7888f8811abd not found: ID does not exist"
Jul 29 01:24:00.060167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.060097    2578 scope.go:117] "RemoveContainer" containerID="d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"
Jul 29 01:24:00.068335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.068313    2578 scope.go:117] "RemoveContainer" containerID="d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"
Jul 29 01:24:00.068603 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:24:00.068568    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df\": container with ID starting with d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df not found: ID does not exist" containerID="d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"
Jul 29 01:24:00.068675 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.068613    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df"} err="failed to get container status \"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df\": rpc error: code = NotFound desc = could not find container \"d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df\": container with ID starting with d66e5dd731fd0e397fcb085de7cb7119352c55994bec05eac5b9e4db99ddc9df not found: ID does not exist"
Jul 29 01:24:00.073276 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.073122    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:24:00.075452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.075428    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gczz7"]
Jul 29 01:24:00.084024 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.084001    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:24:00.087889 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.087870    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77d69bfb9-lgg8n"]
Jul 29 01:24:00.470356 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.470280    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad020f3-90c0-4de8-a520-4ab96384e243" path="/var/lib/kubelet/pods/7ad020f3-90c0-4de8-a520-4ab96384e243/volumes"
Jul 29 01:24:00.470600 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:00.470566    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" path="/var/lib/kubelet/pods/db84c4ad-040d-45e4-8a60-3f2b1e3e44ea/volumes"
Jul 29 01:24:04.375662 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.375628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:04.384604 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.384563    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:04.384994 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.384977    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad020f3-90c0-4de8-a520-4ab96384e243" containerName="authorino"
Jul 29 01:24:04.385067 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.384998    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad020f3-90c0-4de8-a520-4ab96384e243" containerName="authorino"
Jul 29 01:24:04.385067 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.385036    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" containerName="authorino"
Jul 29 01:24:04.385067 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.385045    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" containerName="authorino"
Jul 29 01:24:04.385256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.385226    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db84c4ad-040d-45e4-8a60-3f2b1e3e44ea" containerName="authorino"
Jul 29 01:24:04.385256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.385246    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad020f3-90c0-4de8-a520-4ab96384e243" containerName="authorino"
Jul 29 01:24:04.401130 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.401099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:04.401286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.401241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.403460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.403438    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:24:04.403648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.403629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:24:04.404157 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.404140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h94bm\""
Jul 29 01:24:04.471723 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.471689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:04.476915 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.476888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.477048 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.476935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc4wr\" (UniqueName: \"kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.530565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.530534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:04.572604 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.572559    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:24:04.578393 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.578360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc4wr\" (UniqueName: \"kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.578538 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.578449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.578617 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:24:04.578542    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 29 01:24:04.578669 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:24:04.578624    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert podName:e0dcf96d-a40d-4bcc-bbe3-602a5fff9125 nodeName:}" failed. No retries permitted until 2026-07-29 01:24:05.078607597 +0000 UTC m=+835.107848488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert") pod "maas-controller-84c68b948f-kkvv5" (UID: "e0dcf96d-a40d-4bcc-bbe3-602a5fff9125") : secret "maas-controller-webhook-cert" not found
Jul 29 01:24:04.585188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.585167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.587338 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.587316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:24:04.596870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.596845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc4wr\" (UniqueName: \"kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:04.679542 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.679446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.679719 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.679562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbbw\" (UniqueName: \"kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.689095 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.689071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:04.780376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.780340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbbw\" (UniqueName: \"kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.780623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.780420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.782922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.782899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.788137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.788116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbbw\" (UniqueName: \"kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw\") pod \"maas-controller-76fb7fdd9-24tkw\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") " pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:04.915665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:04.915633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:05.066922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.066899    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:24:05.068943 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:24:05.068913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2176fa_4ccd_43e7_a3fa_45876a7dcc82.slice/crio-a70513d55c801827d134ae757117fc2de17472be6d4f6f0525e8079d0596b50b WatchSource:0}: Error finding container a70513d55c801827d134ae757117fc2de17472be6d4f6f0525e8079d0596b50b: Status 404 returned error can't find the container with id a70513d55c801827d134ae757117fc2de17472be6d4f6f0525e8079d0596b50b
Jul 29 01:24:05.083418 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.083376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:05.086311 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.086286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") pod \"maas-controller-84c68b948f-kkvv5\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") " pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:05.086514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.086491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" event={"ID":"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82","Type":"ContainerStarted","Data":"a70513d55c801827d134ae757117fc2de17472be6d4f6f0525e8079d0596b50b"}
Jul 29 01:24:05.313138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.313096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:05.452716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:05.452689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:05.454211 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:24:05.454183    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dcf96d_a40d_4bcc_bbe3_602a5fff9125.slice/crio-89c8869ae134738b7a86830834205a5b4cf99b8f718415975ae256e2138a4738 WatchSource:0}: Error finding container 89c8869ae134738b7a86830834205a5b4cf99b8f718415975ae256e2138a4738: Status 404 returned error can't find the container with id 89c8869ae134738b7a86830834205a5b4cf99b8f718415975ae256e2138a4738
Jul 29 01:24:06.097692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:06.097654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c68b948f-kkvv5" event={"ID":"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125","Type":"ContainerStarted","Data":"89c8869ae134738b7a86830834205a5b4cf99b8f718415975ae256e2138a4738"}
Jul 29 01:24:07.721544 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:07.721510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:07.831090 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:07.831000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:08.110602 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.110487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c68b948f-kkvv5" event={"ID":"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125","Type":"ContainerStarted","Data":"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"}
Jul 29 01:24:08.110774 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.110619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:08.112387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.112351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" event={"ID":"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82","Type":"ContainerStarted","Data":"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"}
Jul 29 01:24:08.112539 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.112515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:08.135272 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.135220    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84c68b948f-kkvv5" podStartSLOduration=2.049300161 podStartE2EDuration="4.135204966s" totalImagesPullingTime="2.085904805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:08.132858202 +0000 UTC m=+838.162099114" watchObservedRunningTime="2026-07-29 01:24:08.135204966 +0000 UTC m=+838.164445879"
Jul 29 01:24:08.159798 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:08.159746    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" podStartSLOduration=1.6951404989999999 podStartE2EDuration="4.159730676s" totalImagesPullingTime="2.464590177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:08.158564891 +0000 UTC m=+838.187805804" watchObservedRunningTime="2026-07-29 01:24:08.159730676 +0000 UTC m=+838.188971589"
Jul 29 01:24:19.121433 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.121405    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:19.121866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.121474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:24:19.181198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.181163    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:19.181481 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.181440    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84c68b948f-kkvv5" podUID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" containerName="manager" containerID="cri-o://1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177" gracePeriod=30
Jul 29 01:24:19.432653 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.432627    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:19.504069 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.504035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") pod \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") "
Jul 29 01:24:19.504249 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.504161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc4wr\" (UniqueName: \"kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr\") pod \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\" (UID: \"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125\") "
Jul 29 01:24:19.506480 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.506449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" (UID: "e0dcf96d-a40d-4bcc-bbe3-602a5fff9125"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:24:19.506569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.506494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr" (OuterVolumeSpecName: "kube-api-access-pc4wr") pod "e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" (UID: "e0dcf96d-a40d-4bcc-bbe3-602a5fff9125"). InnerVolumeSpecName "kube-api-access-pc4wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:24:19.605076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.605040    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc4wr\" (UniqueName: \"kubernetes.io/projected/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-kube-api-access-pc4wr\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:24:19.605076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:19.605070    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125-webhook-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:24:20.179315 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.179282    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" containerID="1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177" exitCode=0
Jul 29 01:24:20.179771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.179326    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c68b948f-kkvv5"
Jul 29 01:24:20.179771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.179373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c68b948f-kkvv5" event={"ID":"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125","Type":"ContainerDied","Data":"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"}
Jul 29 01:24:20.179771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.179431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c68b948f-kkvv5" event={"ID":"e0dcf96d-a40d-4bcc-bbe3-602a5fff9125","Type":"ContainerDied","Data":"89c8869ae134738b7a86830834205a5b4cf99b8f718415975ae256e2138a4738"}
Jul 29 01:24:20.179771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.179460    2578 scope.go:117] "RemoveContainer" containerID="1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"
Jul 29 01:24:20.189640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.189451    2578 scope.go:117] "RemoveContainer" containerID="1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"
Jul 29 01:24:20.189810 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:24:20.189789    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177\": container with ID starting with 1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177 not found: ID does not exist" containerID="1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"
Jul 29 01:24:20.189856 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.189820    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177"} err="failed to get container status \"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177\": rpc error: code = NotFound desc = could not find container \"1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177\": container with ID starting with 1762934a0b55cfa810764a654d199ce52899e85f9d1c7c351eeffe5fcb4d5177 not found: ID does not exist"
Jul 29 01:24:20.199743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.199717    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:20.203635 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.203615    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84c68b948f-kkvv5"]
Jul 29 01:24:20.470229 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:20.470144    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" path="/var/lib/kubelet/pods/e0dcf96d-a40d-4bcc-bbe3-602a5fff9125/volumes"
Jul 29 01:24:23.231873 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:23.231835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:39.307603 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:39.307534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:39.406135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:39.406091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:39.987314 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:39.987280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:40.054183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.053943    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"]
Jul 29 01:24:40.054885 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.054860    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" containerName="manager"
Jul 29 01:24:40.054885 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.054884    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" containerName="manager"
Jul 29 01:24:40.055029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.054955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dcf96d-a40d-4bcc-bbe3-602a5fff9125" containerName="manager"
Jul 29 01:24:40.058247 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.058230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.061219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.061197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 29 01:24:40.061343 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.061199    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:24:40.066831 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.066799    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"]
Jul 29 01:24:40.099977 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.099921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:40.180142 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.180103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88823cc9-2426-41a1-b9e0-af40d925a7f8-maas-api-tls\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.180361 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.180153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88823cc9-2426-41a1-b9e0-af40d925a7f8-openshift-service-ca\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.180361 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.180214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7t7t\" (UniqueName: \"kubernetes.io/projected/88823cc9-2426-41a1-b9e0-af40d925a7f8-kube-api-access-q7t7t\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.280839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.280803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88823cc9-2426-41a1-b9e0-af40d925a7f8-maas-api-tls\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.281021 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.280854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88823cc9-2426-41a1-b9e0-af40d925a7f8-openshift-service-ca\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.281021 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.280882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7t7t\" (UniqueName: \"kubernetes.io/projected/88823cc9-2426-41a1-b9e0-af40d925a7f8-kube-api-access-q7t7t\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.281744 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.281674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88823cc9-2426-41a1-b9e0-af40d925a7f8-openshift-service-ca\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.283914 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.283886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88823cc9-2426-41a1-b9e0-af40d925a7f8-maas-api-tls\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.290283 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.290255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7t7t\" (UniqueName: \"kubernetes.io/projected/88823cc9-2426-41a1-b9e0-af40d925a7f8-kube-api-access-q7t7t\") pod \"maas-api-58648fb4fc-kc7qj\" (UID: \"88823cc9-2426-41a1-b9e0-af40d925a7f8\") " pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.370940 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.370907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:40.471341 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.471231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:40.530093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.530061    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"]
Jul 29 01:24:40.533344 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:24:40.533318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88823cc9_2426_41a1_b9e0_af40d925a7f8.slice/crio-57f83eac4fcac238470aac7564926d79bcbc641cf786688988aec77f38923765 WatchSource:0}: Error finding container 57f83eac4fcac238470aac7564926d79bcbc641cf786688988aec77f38923765: Status 404 returned error can't find the container with id 57f83eac4fcac238470aac7564926d79bcbc641cf786688988aec77f38923765
Jul 29 01:24:40.565219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.565187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:40.605734 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.605703    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-d47hn"]
Jul 29 01:24:40.610503 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.610488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.613014 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.612975    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rdkjh\""
Jul 29 01:24:40.613394 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.613379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 01:24:40.619001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.618981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-d47hn"]
Jul 29 01:24:40.677173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.677140    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"]
Jul 29 01:24:40.680531 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.680514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.691900 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.691879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"]
Jul 29 01:24:40.783838 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.783751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb724761-4ed7-4d3b-bc9a-894270948223-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.783838 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.783788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtlz\" (UniqueName: \"kubernetes.io/projected/13933f55-0bfd-4f7f-8147-edd459cb360d-kube-api-access-xqtlz\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.784084 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.783855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13933f55-0bfd-4f7f-8147-edd459cb360d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.784084 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.783894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4n6\" (UniqueName: \"kubernetes.io/projected/cb724761-4ed7-4d3b-bc9a-894270948223-kube-api-access-bl4n6\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.884808 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.884769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13933f55-0bfd-4f7f-8147-edd459cb360d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.884996 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.884821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4n6\" (UniqueName: \"kubernetes.io/projected/cb724761-4ed7-4d3b-bc9a-894270948223-kube-api-access-bl4n6\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.884996 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.884908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb724761-4ed7-4d3b-bc9a-894270948223-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.884996 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.884945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtlz\" (UniqueName: \"kubernetes.io/projected/13933f55-0bfd-4f7f-8147-edd459cb360d-kube-api-access-xqtlz\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.885570 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.885534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13933f55-0bfd-4f7f-8147-edd459cb360d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.885719 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.885665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb724761-4ed7-4d3b-bc9a-894270948223-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.892426 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.892403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4n6\" (UniqueName: \"kubernetes.io/projected/cb724761-4ed7-4d3b-bc9a-894270948223-kube-api-access-bl4n6\") pod \"payload-pre-processing-687dbb6cf6-mdzbh\" (UID: \"cb724761-4ed7-4d3b-bc9a-894270948223\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:40.892535 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.892458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtlz\" (UniqueName: \"kubernetes.io/projected/13933f55-0bfd-4f7f-8147-edd459cb360d-kube-api-access-xqtlz\") pod \"payload-processing-5cc6cd444b-d47hn\" (UID: \"13933f55-0bfd-4f7f-8147-edd459cb360d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.922905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.922818    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:40.991400 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:40.991371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:41.073570 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:41.073535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-d47hn"]
Jul 29 01:24:41.076423 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:24:41.076395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13933f55_0bfd_4f7f_8147_edd459cb360d.slice/crio-905be31eeb66fb4ef9901fd2886616a20957706e26fab57382940eb0e6dfaf93 WatchSource:0}: Error finding container 905be31eeb66fb4ef9901fd2886616a20957706e26fab57382940eb0e6dfaf93: Status 404 returned error can't find the container with id 905be31eeb66fb4ef9901fd2886616a20957706e26fab57382940eb0e6dfaf93
Jul 29 01:24:41.141826 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:41.141792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"]
Jul 29 01:24:41.143404 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:24:41.143382    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb724761_4ed7_4d3b_bc9a_894270948223.slice/crio-3cec772fe79ff2b4023284c05c7b4e404adeb06f5c80cdb24d9cb3a860ba8530 WatchSource:0}: Error finding container 3cec772fe79ff2b4023284c05c7b4e404adeb06f5c80cdb24d9cb3a860ba8530: Status 404 returned error can't find the container with id 3cec772fe79ff2b4023284c05c7b4e404adeb06f5c80cdb24d9cb3a860ba8530
Jul 29 01:24:41.296864 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:41.296815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh" event={"ID":"cb724761-4ed7-4d3b-bc9a-894270948223","Type":"ContainerStarted","Data":"3cec772fe79ff2b4023284c05c7b4e404adeb06f5c80cdb24d9cb3a860ba8530"}
Jul 29 01:24:41.299682 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:41.299597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn" event={"ID":"13933f55-0bfd-4f7f-8147-edd459cb360d","Type":"ContainerStarted","Data":"905be31eeb66fb4ef9901fd2886616a20957706e26fab57382940eb0e6dfaf93"}
Jul 29 01:24:41.302612 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:41.302567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj" event={"ID":"88823cc9-2426-41a1-b9e0-af40d925a7f8","Type":"ContainerStarted","Data":"57f83eac4fcac238470aac7564926d79bcbc641cf786688988aec77f38923765"}
Jul 29 01:24:43.320315 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.320269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn" event={"ID":"13933f55-0bfd-4f7f-8147-edd459cb360d","Type":"ContainerStarted","Data":"79c8e4fd009fb5809019e9bd726c7a3e6c0f61101591b0916eb0e30fc67cc2f1"}
Jul 29 01:24:43.320789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.320386    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:43.321988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.321965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj" event={"ID":"88823cc9-2426-41a1-b9e0-af40d925a7f8","Type":"ContainerStarted","Data":"3c9cfb6437dd552689df45c05765ffe86abeca28c2fd483e7ca68ab38a0500c6"}
Jul 29 01:24:43.322065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.322052    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:43.323559 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.323538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh" event={"ID":"cb724761-4ed7-4d3b-bc9a-894270948223","Type":"ContainerStarted","Data":"dd14cc2c1c80723031b29c3757328dfa8fc3a48f7850ef50dabd8e49e506c32c"}
Jul 29 01:24:43.323701 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.323619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:24:43.349041 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.348993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn" podStartSLOduration=1.528659959 podStartE2EDuration="3.348979381s" totalImagesPullingTime="1.820319422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:43.346342339 +0000 UTC m=+873.375583251" watchObservedRunningTime="2026-07-29 01:24:43.348979381 +0000 UTC m=+873.378220293"
Jul 29 01:24:43.386784 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.386736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh" podStartSLOduration=1.6269228569999998 podStartE2EDuration="3.38672012s" totalImagesPullingTime="1.759797263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:43.384756353 +0000 UTC m=+873.413997265" watchObservedRunningTime="2026-07-29 01:24:43.38672012 +0000 UTC m=+873.415961034"
Jul 29 01:24:43.437946 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:43.437893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj" podStartSLOduration=1.488563716 podStartE2EDuration="3.437873926s" totalImagesPullingTime="1.94931021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:43.437744943 +0000 UTC m=+873.466985858" watchObservedRunningTime="2026-07-29 01:24:43.437873926 +0000 UTC m=+873.467114841"
Jul 29 01:24:49.334205 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:49.334173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58648fb4fc-kc7qj"
Jul 29 01:24:50.928781 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:50.928744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:51.031161 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:51.031132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:54.331091 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:54.331048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-d47hn"
Jul 29 01:24:54.331600 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:24:54.331131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-mdzbh"
Jul 29 01:25:06.945607 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.945548    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"]
Jul 29 01:25:06.949068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.949047    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:06.952196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.952175    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:25:06.952196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.952189    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 01:25:06.952367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.952211    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:25:06.952367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.952175    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpzrx\""
Jul 29 01:25:06.961613 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.961569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"]
Jul 29 01:25:06.966776 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:06.966736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:07.025660 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.025823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.025823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.025823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv928\" (UniqueName: \"kubernetes.io/projected/64f4baf9-1338-416f-8b82-392d97e696eb-kube-api-access-xv928\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.025945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64f4baf9-1338-416f-8b82-392d97e696eb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.025945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.025865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126687 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv928\" (UniqueName: \"kubernetes.io/projected/64f4baf9-1338-416f-8b82-392d97e696eb-kube-api-access-xv928\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64f4baf9-1338-416f-8b82-392d97e696eb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.126905 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.126807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.127172 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.127144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.127282 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.127184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.127282 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.127201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.129107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.129086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64f4baf9-1338-416f-8b82-392d97e696eb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.129385 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.129367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64f4baf9-1338-416f-8b82-392d97e696eb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.134551 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.134530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv928\" (UniqueName: \"kubernetes.io/projected/64f4baf9-1338-416f-8b82-392d97e696eb-kube-api-access-xv928\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk\" (UID: \"64f4baf9-1338-416f-8b82-392d97e696eb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.260264 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.260232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:07.405699 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.405670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"]
Jul 29 01:25:07.407290 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:25:07.407265    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f4baf9_1338_416f_8b82_392d97e696eb.slice/crio-3fbc443cbeef45c95e823f84c037cbf4c05b9e9643e889a9e07ae9b4e67fdc6a WatchSource:0}: Error finding container 3fbc443cbeef45c95e823f84c037cbf4c05b9e9643e889a9e07ae9b4e67fdc6a: Status 404 returned error can't find the container with id 3fbc443cbeef45c95e823f84c037cbf4c05b9e9643e889a9e07ae9b4e67fdc6a
Jul 29 01:25:07.458342 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:07.458314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk" event={"ID":"64f4baf9-1338-416f-8b82-392d97e696eb","Type":"ContainerStarted","Data":"3fbc443cbeef45c95e823f84c037cbf4c05b9e9643e889a9e07ae9b4e67fdc6a"}
Jul 29 01:25:09.470754 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:09.470719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk" event={"ID":"64f4baf9-1338-416f-8b82-392d97e696eb","Type":"ContainerStarted","Data":"aa825a38bd2029373d087a07833a88b9a95806f9a157fd169b6d8666fdde5d06"}
Jul 29 01:25:09.487436 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:09.487385    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk" podStartSLOduration=2.410245555 podStartE2EDuration="3.487369542s" totalImagesPullingTime="1.077123987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:09.48622 +0000 UTC m=+899.515460914" watchObservedRunningTime="2026-07-29 01:25:09.487369542 +0000 UTC m=+899.516610454"
Jul 29 01:25:17.260985 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:17.260946    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:17.263625 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:17.261227    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:17.273700 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:17.273682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:17.527272 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:17.527194    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk"
Jul 29 01:25:27.991486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:27.991452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:28.496111 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:28.496061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:38.639443 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.639412    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"]
Jul 29 01:25:38.644898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.644872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.647186 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.647159    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 01:25:38.654826 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.654805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"]
Jul 29 01:25:38.676429 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.676397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:38.711367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.711532 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.711532 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.711532 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.711709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.711709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.711597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2tl5\" (UniqueName: \"kubernetes.io/projected/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-kube-api-access-j2tl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813076 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2tl5\" (UniqueName: \"kubernetes.io/projected/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-kube-api-access-j2tl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813622 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813622 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.813749 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.813618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.815399 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.815379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.815857 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.815834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.821640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.821621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2tl5\" (UniqueName: \"kubernetes.io/projected/a1d6ab86-960a-4802-a4db-0f1c1e3af31e-kube-api-access-j2tl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-prqgm\" (UID: \"a1d6ab86-960a-4802-a4db-0f1c1e3af31e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:38.958157 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:38.958076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:39.102138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:39.102107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"]
Jul 29 01:25:39.103059 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:25:39.103021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d6ab86_960a_4802_a4db_0f1c1e3af31e.slice/crio-d66e5c543b7856c3a7d0b8c140eb1994fd1a5df2263b9f0f581df35eb50e0d14 WatchSource:0}: Error finding container d66e5c543b7856c3a7d0b8c140eb1994fd1a5df2263b9f0f581df35eb50e0d14: Status 404 returned error can't find the container with id d66e5c543b7856c3a7d0b8c140eb1994fd1a5df2263b9f0f581df35eb50e0d14
Jul 29 01:25:39.104675 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:39.104647    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:25:39.648378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:39.648298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm" event={"ID":"a1d6ab86-960a-4802-a4db-0f1c1e3af31e","Type":"ContainerStarted","Data":"a322a19b7d02b0825f77ad9cf4f5808bedd5c54272e4c47c64242b9310067b96"}
Jul 29 01:25:39.648378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:39.648344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm" event={"ID":"a1d6ab86-960a-4802-a4db-0f1c1e3af31e","Type":"ContainerStarted","Data":"d66e5c543b7856c3a7d0b8c140eb1994fd1a5df2263b9f0f581df35eb50e0d14"}
Jul 29 01:25:39.666501 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:39.666437    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm" podStartSLOduration=1.438216227 podStartE2EDuration="1.666421567s" totalImagesPullingTime="228.20534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:39.665228731 +0000 UTC m=+929.694469643" watchObservedRunningTime="2026-07-29 01:25:39.666421567 +0000 UTC m=+929.695662480"
Jul 29 01:25:47.211057 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:47.211023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:47.270803 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:47.270760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:48.958786 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:48.958754    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:48.959224 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:48.959038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:48.971424 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:48.971397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:49.717586 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:49.717537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-prqgm"
Jul 29 01:25:55.285223 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:55.285182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:56.734793 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:56.734760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:56.787892 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:25:56.787862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:02.755807 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.755775    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"]
Jul 29 01:26:02.760546 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.760526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.762842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.762815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 01:26:02.768243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.768222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"]
Jul 29 01:26:02.794816 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.794783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:02.831702 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.831880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.831880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptxsr\" (UniqueName: \"kubernetes.io/projected/297c32f2-850b-444c-aa50-e96e60f4e0e5-kube-api-access-ptxsr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.831880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/297c32f2-850b-444c-aa50-e96e60f4e0e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.831880 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.832096 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.831938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933312 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptxsr\" (UniqueName: \"kubernetes.io/projected/297c32f2-850b-444c-aa50-e96e60f4e0e5-kube-api-access-ptxsr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933312 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/297c32f2-850b-444c-aa50-e96e60f4e0e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933312 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933312 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933494 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933724 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.933791 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.933751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.935688 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.935670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/297c32f2-850b-444c-aa50-e96e60f4e0e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.935868 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.935850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/297c32f2-850b-444c-aa50-e96e60f4e0e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:02.941188 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:02.941167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptxsr\" (UniqueName: \"kubernetes.io/projected/297c32f2-850b-444c-aa50-e96e60f4e0e5-kube-api-access-ptxsr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rp5q\" (UID: \"297c32f2-850b-444c-aa50-e96e60f4e0e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:03.085318 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:03.085230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:03.227374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:03.227344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"]
Jul 29 01:26:03.228490 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:26:03.228467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297c32f2_850b_444c_aa50_e96e60f4e0e5.slice/crio-06a6ef92350c7dbc1d617f98884a6e366700066caa90c8cf451b01a000e07410 WatchSource:0}: Error finding container 06a6ef92350c7dbc1d617f98884a6e366700066caa90c8cf451b01a000e07410: Status 404 returned error can't find the container with id 06a6ef92350c7dbc1d617f98884a6e366700066caa90c8cf451b01a000e07410
Jul 29 01:26:03.789149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:03.789117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q" event={"ID":"297c32f2-850b-444c-aa50-e96e60f4e0e5","Type":"ContainerStarted","Data":"dd89da1010337cd853bcab8636027e71089dee1a6216d4ec197311667c19843d"}
Jul 29 01:26:03.789543 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:03.789165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q" event={"ID":"297c32f2-850b-444c-aa50-e96e60f4e0e5","Type":"ContainerStarted","Data":"06a6ef92350c7dbc1d617f98884a6e366700066caa90c8cf451b01a000e07410"}
Jul 29 01:26:03.807856 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:03.807810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q" podStartSLOduration=1.599896855 podStartE2EDuration="1.807793432s" totalImagesPullingTime="207.896577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:26:03.805309682 +0000 UTC m=+953.834550596" watchObservedRunningTime="2026-07-29 01:26:03.807793432 +0000 UTC m=+953.837034345"
Jul 29 01:26:11.681308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:11.681273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:13.085658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:13.085621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:13.086113 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:13.085685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:13.097704 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:13.097679    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:13.863022 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:13.862996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rp5q"
Jul 29 01:26:39.908292 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:39.908250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:42.064896 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:26:42.064858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:06.092250 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:06.092204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:06.191309 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:06.191281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:07.235087 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:07.235048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:07.352352 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:07.352321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:52.833630 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:52.833596    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:27:52.834132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:52.833847    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" podUID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" containerName="manager" containerID="cri-o://e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632" gracePeriod=30
Jul 29 01:27:53.087486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.087414    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:27:53.264902 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.264865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert\") pod \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") "
Jul 29 01:27:53.265094 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.264983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdbbw\" (UniqueName: \"kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw\") pod \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\" (UID: \"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82\") "
Jul 29 01:27:53.267112 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.267079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw" (OuterVolumeSpecName: "kube-api-access-zdbbw") pod "fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" (UID: "fc2176fa-4ccd-43e7-a3fa-45876a7dcc82"). InnerVolumeSpecName "kube-api-access-zdbbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:27:53.267227 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.267162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" (UID: "fc2176fa-4ccd-43e7-a3fa-45876a7dcc82"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:27:53.365972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.365896    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-webhook-cert\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:27:53.365972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.365925    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdbbw\" (UniqueName: \"kubernetes.io/projected/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82-kube-api-access-zdbbw\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:27:53.411216 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.411183    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" containerID="e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632" exitCode=0
Jul 29 01:27:53.411374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.411231    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-24tkw"
Jul 29 01:27:53.411374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.411269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" event={"ID":"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82","Type":"ContainerDied","Data":"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"}
Jul 29 01:27:53.411374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.411325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-24tkw" event={"ID":"fc2176fa-4ccd-43e7-a3fa-45876a7dcc82","Type":"ContainerDied","Data":"a70513d55c801827d134ae757117fc2de17472be6d4f6f0525e8079d0596b50b"}
Jul 29 01:27:53.411374 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.411353    2578 scope.go:117] "RemoveContainer" containerID="e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"
Jul 29 01:27:53.428569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.428549    2578 scope.go:117] "RemoveContainer" containerID="e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"
Jul 29 01:27:53.428934 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:27:53.428908    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632\": container with ID starting with e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632 not found: ID does not exist" containerID="e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"
Jul 29 01:27:53.429031 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.428937    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632"} err="failed to get container status \"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632\": rpc error: code = NotFound desc = could not find container \"e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632\": container with ID starting with e22fd8589c39cb2de7cae313670cacc4a72607919cb659ae6745f2c368468632 not found: ID does not exist"
Jul 29 01:27:53.437472 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.437448    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:27:53.441492 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:53.441468    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-24tkw"]
Jul 29 01:27:54.470821 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:27:54.470789    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" path="/var/lib/kubelet/pods/fc2176fa-4ccd-43e7-a3fa-45876a7dcc82/volumes"
Jul 29 01:28:29.448765 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:28:29.448733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:28:29.548885 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:28:29.548850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:12.778783 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:29:12.778749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:14.019842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:29:14.019804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:57.489235 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:29:57.489203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:57.580514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:29:57.580481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:57.691787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:29:57.691757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:00.144171 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.144141    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"]
Jul 29 01:30:00.144595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.144561    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" containerName="manager"
Jul 29 01:30:00.144595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.144591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" containerName="manager"
Jul 29 01:30:00.144693 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.144674    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2176fa-4ccd-43e7-a3fa-45876a7dcc82" containerName="manager"
Jul 29 01:30:00.147887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.147865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"
Jul 29 01:30:00.150297 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.150277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:30:00.156570 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.156542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"]
Jul 29 01:30:00.159165 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.159142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"
Jul 29 01:30:00.510007 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:00.509976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"]
Jul 29 01:30:00.511416 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:30:00.511390    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afb6498_fcf0_490e_ab64_e1d75225a0b8.slice/crio-42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411 WatchSource:0}: Error finding container 42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411: Status 404 returned error can't find the container with id 42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411
Jul 29 01:30:01.137991 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:01.137953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t" event={"ID":"5afb6498-fcf0-490e-ab64-e1d75225a0b8","Type":"ContainerStarted","Data":"42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411"}
Jul 29 01:30:03.373690 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:03.373655    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:03.497776 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:03.497743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:03.588057 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:03.587971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:03.709801 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:03.709772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:04.157839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:04.157806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t" event={"ID":"5afb6498-fcf0-490e-ab64-e1d75225a0b8","Type":"ContainerStarted","Data":"cf1f6e7534dc702103a1cba63d0250b5ff260cdacc0ef0eae221ca73a653801c"}
Jul 29 01:30:04.173282 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:04.173236    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t" podStartSLOduration=1.393233264 podStartE2EDuration="4.173222105s" totalImagesPullingTime="2.779988841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:30:04.171762747 +0000 UTC m=+1194.201003659" watchObservedRunningTime="2026-07-29 01:30:04.173222105 +0000 UTC m=+1194.202463377"
Jul 29 01:30:05.167848 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:05.167814    2578 generic.go:356] "Generic (PLEG): container finished" podID="5afb6498-fcf0-490e-ab64-e1d75225a0b8" containerID="cf1f6e7534dc702103a1cba63d0250b5ff260cdacc0ef0eae221ca73a653801c" exitCode=0
Jul 29 01:30:05.168320 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:05.167890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t" event={"ID":"5afb6498-fcf0-490e-ab64-e1d75225a0b8","Type":"ContainerDied","Data":"cf1f6e7534dc702103a1cba63d0250b5ff260cdacc0ef0eae221ca73a653801c"}
Jul 29 01:30:06.316829 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:06.316794    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"
Jul 29 01:30:07.180958 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:07.180930    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t"
Jul 29 01:30:07.181149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:07.180974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-5x62t" event={"ID":"5afb6498-fcf0-490e-ab64-e1d75225a0b8","Type":"ContainerDied","Data":"42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411"}
Jul 29 01:30:07.181149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:07.181026    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42e392b12065334f6d606d216e542e092d7eccc312491fe8051f0526b971f411"
Jul 29 01:30:09.589634 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:09.589603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:30:09.658724 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:30:09.658690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:31:58.669993 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:31:58.669962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:33:35.540920 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:33:35.540885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:33:35.599896 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:33:35.599863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:33:43.138217 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:33:43.138183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:33:47.562980 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:33:47.562944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:34:23.503638 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:23.503551    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:34:23.504144 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:23.503816    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" podUID="09c60a50-7abe-4a89-8453-4e64e09af1d2" containerName="manager" containerID="cri-o://79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48" gracePeriod=10
Jul 29 01:34:26.259371 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.259343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:34:26.290748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.290721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume\") pod \"09c60a50-7abe-4a89-8453-4e64e09af1d2\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") "
Jul 29 01:34:26.290925 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.290767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjccx\" (UniqueName: \"kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx\") pod \"09c60a50-7abe-4a89-8453-4e64e09af1d2\" (UID: \"09c60a50-7abe-4a89-8453-4e64e09af1d2\") "
Jul 29 01:34:26.291092 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.291071    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "09c60a50-7abe-4a89-8453-4e64e09af1d2" (UID: "09c60a50-7abe-4a89-8453-4e64e09af1d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:34:26.292989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.292955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx" (OuterVolumeSpecName: "kube-api-access-fjccx") pod "09c60a50-7abe-4a89-8453-4e64e09af1d2" (UID: "09c60a50-7abe-4a89-8453-4e64e09af1d2"). InnerVolumeSpecName "kube-api-access-fjccx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:34:26.392304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.392225    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c60a50-7abe-4a89-8453-4e64e09af1d2-extensions-socket-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:34:26.392304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.392251    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjccx\" (UniqueName: \"kubernetes.io/projected/09c60a50-7abe-4a89-8453-4e64e09af1d2-kube-api-access-fjccx\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:34:26.686775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.686682    2578 generic.go:356] "Generic (PLEG): container finished" podID="09c60a50-7abe-4a89-8453-4e64e09af1d2" containerID="79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48" exitCode=0
Jul 29 01:34:26.686775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.686725    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"
Jul 29 01:34:26.686970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.686772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" event={"ID":"09c60a50-7abe-4a89-8453-4e64e09af1d2","Type":"ContainerDied","Data":"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"}
Jul 29 01:34:26.686970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.686823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df" event={"ID":"09c60a50-7abe-4a89-8453-4e64e09af1d2","Type":"ContainerDied","Data":"aadcf9fb58cf8f0fbc6c5cc875af42ed2e9984746bb7cb593844eeeeb47114d1"}
Jul 29 01:34:26.686970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.686848    2578 scope.go:117] "RemoveContainer" containerID="79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"
Jul 29 01:34:26.697095 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.697078    2578 scope.go:117] "RemoveContainer" containerID="79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"
Jul 29 01:34:26.697358 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:34:26.697336    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48\": container with ID starting with 79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48 not found: ID does not exist" containerID="79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"
Jul 29 01:34:26.697443 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.697368    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48"} err="failed to get container status \"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48\": rpc error: code = NotFound desc = could not find container \"79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48\": container with ID starting with 79cd01d2af90cf279bfe08aa001b8f27fa1bb818aa5960c1aaab1fb5d518da48 not found: ID does not exist"
Jul 29 01:34:26.704204 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.704182    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:34:26.711472 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:26.711449    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2q9df"]
Jul 29 01:34:28.470224 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:34:28.470195    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c60a50-7abe-4a89-8453-4e64e09af1d2" path="/var/lib/kubelet/pods/09c60a50-7abe-4a89-8453-4e64e09af1d2/volumes"
Jul 29 01:35:24.625151 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625117    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"]
Jul 29 01:35:24.625647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625509    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c60a50-7abe-4a89-8453-4e64e09af1d2" containerName="manager"
Jul 29 01:35:24.625647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625520    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c60a50-7abe-4a89-8453-4e64e09af1d2" containerName="manager"
Jul 29 01:35:24.625647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625559    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afb6498-fcf0-490e-ab64-e1d75225a0b8" containerName="cleanup"
Jul 29 01:35:24.625647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625564    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afb6498-fcf0-490e-ab64-e1d75225a0b8" containerName="cleanup"
Jul 29 01:35:24.625779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625650    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c60a50-7abe-4a89-8453-4e64e09af1d2" containerName="manager"
Jul 29 01:35:24.625779 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.625660    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5afb6498-fcf0-490e-ab64-e1d75225a0b8" containerName="cleanup"
Jul 29 01:35:24.629887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.629870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.638072 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.638053    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrxxz\""
Jul 29 01:35:24.659701 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.659672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"]
Jul 29 01:35:24.729753 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.729702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6dm4\" (UniqueName: \"kubernetes.io/projected/9dceae4a-77a1-4298-8c07-e956d0f34262-kube-api-access-r6dm4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.729926 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.729797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dceae4a-77a1-4298-8c07-e956d0f34262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.831170 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.831139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6dm4\" (UniqueName: \"kubernetes.io/projected/9dceae4a-77a1-4298-8c07-e956d0f34262-kube-api-access-r6dm4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.831352 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.831199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dceae4a-77a1-4298-8c07-e956d0f34262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.831592 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.831560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dceae4a-77a1-4298-8c07-e956d0f34262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.840246 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.840224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6dm4\" (UniqueName: \"kubernetes.io/projected/9dceae4a-77a1-4298-8c07-e956d0f34262-kube-api-access-r6dm4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8wkp\" (UID: \"9dceae4a-77a1-4298-8c07-e956d0f34262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:24.939625 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:24.939513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:25.079761 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:25.079733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"]
Jul 29 01:35:25.081840 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:35:25.081813    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dceae4a_77a1_4298_8c07_e956d0f34262.slice/crio-a8532d002f8dd11c2bd1e560dfba83636c20de1c6c7642f5b26e181331413050 WatchSource:0}: Error finding container a8532d002f8dd11c2bd1e560dfba83636c20de1c6c7642f5b26e181331413050: Status 404 returned error can't find the container with id a8532d002f8dd11c2bd1e560dfba83636c20de1c6c7642f5b26e181331413050
Jul 29 01:35:26.025042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:26.025006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp" event={"ID":"9dceae4a-77a1-4298-8c07-e956d0f34262","Type":"ContainerStarted","Data":"e8a6cb65e661be13bba892559c9495f8a467d80f8f99f1d33c2cd4eed4792ef9"}
Jul 29 01:35:26.025441 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:26.025056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp" event={"ID":"9dceae4a-77a1-4298-8c07-e956d0f34262","Type":"ContainerStarted","Data":"a8532d002f8dd11c2bd1e560dfba83636c20de1c6c7642f5b26e181331413050"}
Jul 29 01:35:26.025441 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:26.025142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:35:26.047714 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:26.047659    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp" podStartSLOduration=2.047639922 podStartE2EDuration="2.047639922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:35:26.045806411 +0000 UTC m=+1516.075047325" watchObservedRunningTime="2026-07-29 01:35:26.047639922 +0000 UTC m=+1516.076880871"
Jul 29 01:35:37.033181 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:35:37.033153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8wkp"
Jul 29 01:37:23.292191 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:37:23.292099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:37:24.774820 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:37:24.774787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:38:21.698877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:38:21.698841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:38:31.788367 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:38:31.788331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:38:59.010902 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:38:59.010867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:00.088244 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:39:00.088206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:48.124839 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:40:48.124805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:48.214148 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:40:48.214116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:36.598467 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:41:36.598429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:08.708542 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:08.708500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:30.467680 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:30.467642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:33.533362 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:33.533322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:33.629722 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:33.629690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:34.013185 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:34.013141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:39.892607 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:39.892547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:39.993881 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:39.993837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:40.095277 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:40.095240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:40.310083 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:40.310048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:40.468721 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:40.468686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:42.446368 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:42.446331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:42.542377 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:42.542336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:42.741990 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:42.741902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:43.212230 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.212198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:43.314102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.314064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:43.351121 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.351075    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:42:43.355058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.355039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.357590 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.357557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d9d88784-dockercfg-vzcm2\""
Jul 29 01:42:43.357760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.357741    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d9d88784\""
Jul 29 01:42:43.364054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.364026    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:42:43.367755 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.367735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.372004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.371983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:42:43.384691 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.384662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:42:43.450956 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.450923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.451335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.450966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdqkd\" (UniqueName: \"kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.451335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.451040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w49zg\" (UniqueName: \"kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.451335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.451066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.552478 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.552435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.552748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.552487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdqkd\" (UniqueName: \"kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.552748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.552566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w49zg\" (UniqueName: \"kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.552748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.552644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.553307 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.553286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.553401 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.553382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.561768 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.561730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdqkd\" (UniqueName: \"kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd\") pod \"payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") " pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.561887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.561793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w49zg\" (UniqueName: \"kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg\") pod \"payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.665901 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.665846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:43.679168 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.679141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:43.841203 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.841160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:42:43.842983 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:42:43.842930    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6031257b_4ed4_4014_b235_c355ba2418b4.slice/crio-3add58fe2511a59e4435f744d72183f32698531965893a7a51ffc2ba9432a5dc WatchSource:0}: Error finding container 3add58fe2511a59e4435f744d72183f32698531965893a7a51ffc2ba9432a5dc: Status 404 returned error can't find the container with id 3add58fe2511a59e4435f744d72183f32698531965893a7a51ffc2ba9432a5dc
Jul 29 01:42:43.873158 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:43.873134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:42:43.876772 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:42:43.876744    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a6ccf3_486f_4afd_8641_777fa1828cb3.slice/crio-89d8d8d2b1efe22c277dd8786cf47a4ec11574f779b5c10faedc6793007f23e6 WatchSource:0}: Error finding container 89d8d8d2b1efe22c277dd8786cf47a4ec11574f779b5c10faedc6793007f23e6: Status 404 returned error can't find the container with id 89d8d8d2b1efe22c277dd8786cf47a4ec11574f779b5c10faedc6793007f23e6
Jul 29 01:42:44.538428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.538377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" event={"ID":"f9a6ccf3-486f-4afd-8641-777fa1828cb3","Type":"ContainerStarted","Data":"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"}
Jul 29 01:42:44.538958 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.538470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" event={"ID":"f9a6ccf3-486f-4afd-8641-777fa1828cb3","Type":"ContainerStarted","Data":"89d8d8d2b1efe22c277dd8786cf47a4ec11574f779b5c10faedc6793007f23e6"}
Jul 29 01:42:44.538958 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.538502    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:42:44.540056 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.540032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" event={"ID":"6031257b-4ed4-4014-b235-c355ba2418b4","Type":"ContainerStarted","Data":"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"}
Jul 29 01:42:44.540183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.540073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" event={"ID":"6031257b-4ed4-4014-b235-c355ba2418b4","Type":"ContainerStarted","Data":"3add58fe2511a59e4435f744d72183f32698531965893a7a51ffc2ba9432a5dc"}
Jul 29 01:42:44.540183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.540116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:44.556764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.556712    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" podStartSLOduration=1.556695194 podStartE2EDuration="1.556695194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:44.55499158 +0000 UTC m=+1954.584232507" watchObservedRunningTime="2026-07-29 01:42:44.556695194 +0000 UTC m=+1954.585936107"
Jul 29 01:42:44.571602 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:44.571519    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" podStartSLOduration=1.5715014200000001 podStartE2EDuration="1.57150142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:44.568787612 +0000 UTC m=+1954.598028527" watchObservedRunningTime="2026-07-29 01:42:44.57150142 +0000 UTC m=+1954.600742336"
Jul 29 01:42:55.549138 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:55.549101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:42:55.549683 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:42:55.549176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:43:23.213155 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.213070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.249999 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.249959    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:43:23.250286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.250232    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" podUID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" containerName="payload-processing" containerID="cri-o://dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290" gracePeriod=30
Jul 29 01:43:23.255047 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.255023    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:43:23.255275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.255246    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" podUID="6031257b-4ed4-4014-b235-c355ba2418b4" containerName="payload-pre-processing" containerID="cri-o://a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3" gracePeriod=30
Jul 29 01:43:23.291147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.291119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.387426 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.387394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.465360 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.465274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.558293 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.558246    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:43:23.561717 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.561690    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:43:23.580001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.579964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.644989 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.644960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume\") pod \"6031257b-4ed4-4014-b235-c355ba2418b4\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") "
Jul 29 01:43:23.645153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.645009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdqkd\" (UniqueName: \"kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd\") pod \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") "
Jul 29 01:43:23.645153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.645085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume\") pod \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\" (UID: \"f9a6ccf3-486f-4afd-8641-777fa1828cb3\") "
Jul 29 01:43:23.645153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.645116    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w49zg\" (UniqueName: \"kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg\") pod \"6031257b-4ed4-4014-b235-c355ba2418b4\" (UID: \"6031257b-4ed4-4014-b235-c355ba2418b4\") "
Jul 29 01:43:23.645459 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.645436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6031257b-4ed4-4014-b235-c355ba2418b4" (UID: "6031257b-4ed4-4014-b235-c355ba2418b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:43:23.645517 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.645497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9a6ccf3-486f-4afd-8641-777fa1828cb3" (UID: "f9a6ccf3-486f-4afd-8641-777fa1828cb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:43:23.647479 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.647450    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd" (OuterVolumeSpecName: "kube-api-access-bdqkd") pod "f9a6ccf3-486f-4afd-8641-777fa1828cb3" (UID: "f9a6ccf3-486f-4afd-8641-777fa1828cb3"). InnerVolumeSpecName "kube-api-access-bdqkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:43:23.647631 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.647523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg" (OuterVolumeSpecName: "kube-api-access-w49zg") pod "6031257b-4ed4-4014-b235-c355ba2418b4" (UID: "6031257b-4ed4-4014-b235-c355ba2418b4"). InnerVolumeSpecName "kube-api-access-w49zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:43:23.746182 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.746152    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6031257b-4ed4-4014-b235-c355ba2418b4-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.746182 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.746182    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdqkd\" (UniqueName: \"kubernetes.io/projected/f9a6ccf3-486f-4afd-8641-777fa1828cb3-kube-api-access-bdqkd\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.746389 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.746196    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9a6ccf3-486f-4afd-8641-777fa1828cb3-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.746389 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.746208    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w49zg\" (UniqueName: \"kubernetes.io/projected/6031257b-4ed4-4014-b235-c355ba2418b4-kube-api-access-w49zg\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.772766 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.772729    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" containerID="dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290" exitCode=0
Jul 29 01:43:23.772898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.772778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"
Jul 29 01:43:23.772898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.772813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" event={"ID":"f9a6ccf3-486f-4afd-8641-777fa1828cb3","Type":"ContainerDied","Data":"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"}
Jul 29 01:43:23.772898 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.772864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l" event={"ID":"f9a6ccf3-486f-4afd-8641-777fa1828cb3","Type":"ContainerDied","Data":"89d8d8d2b1efe22c277dd8786cf47a4ec11574f779b5c10faedc6793007f23e6"}
Jul 29 01:43:23.773030 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.772894    2578 scope.go:117] "RemoveContainer" containerID="dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"
Jul 29 01:43:23.774361 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.774340    2578 generic.go:356] "Generic (PLEG): container finished" podID="6031257b-4ed4-4014-b235-c355ba2418b4" containerID="a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3" exitCode=0
Jul 29 01:43:23.774460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.774380    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"
Jul 29 01:43:23.774517 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.774374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" event={"ID":"6031257b-4ed4-4014-b235-c355ba2418b4","Type":"ContainerDied","Data":"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"}
Jul 29 01:43:23.774517 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.774510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht" event={"ID":"6031257b-4ed4-4014-b235-c355ba2418b4","Type":"ContainerDied","Data":"3add58fe2511a59e4435f744d72183f32698531965893a7a51ffc2ba9432a5dc"}
Jul 29 01:43:23.789872 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.784131    2578 scope.go:117] "RemoveContainer" containerID="dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"
Jul 29 01:43:23.789872 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:43:23.789845    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290\": container with ID starting with dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290 not found: ID does not exist" containerID="dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"
Jul 29 01:43:23.790169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.789891    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290"} err="failed to get container status \"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290\": rpc error: code = NotFound desc = could not find container \"dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290\": container with ID starting with dfa00dccc7232a2460820c930c6d1e0a20ad20ca3ebd6e7fbd7ba1ea84ab9290 not found: ID does not exist"
Jul 29 01:43:23.790169 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.789917    2578 scope.go:117] "RemoveContainer" containerID="a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"
Jul 29 01:43:23.800832 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.800808    2578 scope.go:117] "RemoveContainer" containerID="a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"
Jul 29 01:43:23.801101 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.801079    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:43:23.801208 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:43:23.801118    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3\": container with ID starting with a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3 not found: ID does not exist" containerID="a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"
Jul 29 01:43:23.801208 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.801142    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3"} err="failed to get container status \"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3\": rpc error: code = NotFound desc = could not find container \"a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3\": container with ID starting with a5414f7ad2dde2283b1d1ff0d73e3b914d638db816e8fb197e45ad9cf62a05e3 not found: ID does not exist"
Jul 29 01:43:23.807095 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.807072    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d9d88784-596d448fb8-52w6l"]
Jul 29 01:43:23.818679 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.818656    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:43:23.824243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.824220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:23.824866 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:23.824844    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d9d88784-64f95d65d8-fl6ht"]
Jul 29 01:43:24.145998 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.145896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:24.251177 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.251146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:24.344907 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.344875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:24.471468 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.471386    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6031257b-4ed4-4014-b235-c355ba2418b4" path="/var/lib/kubelet/pods/6031257b-4ed4-4014-b235-c355ba2418b4/volumes"
Jul 29 01:43:24.471970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.471951    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" path="/var/lib/kubelet/pods/f9a6ccf3-486f-4afd-8641-777fa1828cb3/volumes"
Jul 29 01:43:24.599980 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.599949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:24.693414 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:24.693383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:27.292129 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:27.292097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:27.486817 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:27.486777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.018460 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.018422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.122336 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.122296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.128725 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.128698    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:43:28.129159 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129143    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" containerName="payload-processing"
Jul 29 01:43:28.129201 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129163    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" containerName="payload-processing"
Jul 29 01:43:28.129201 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129176    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6031257b-4ed4-4014-b235-c355ba2418b4" containerName="payload-pre-processing"
Jul 29 01:43:28.129201 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129182    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6031257b-4ed4-4014-b235-c355ba2418b4" containerName="payload-pre-processing"
Jul 29 01:43:28.129298 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129253    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6031257b-4ed4-4014-b235-c355ba2418b4" containerName="payload-pre-processing"
Jul 29 01:43:28.129298 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.129263    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a6ccf3-486f-4afd-8641-777fa1828cb3" containerName="payload-processing"
Jul 29 01:43:28.133950 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.133930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.136624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.136601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a63cc33b-dockercfg-29d49\""
Jul 29 01:43:28.136973 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.136959    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a63cc33b\""
Jul 29 01:43:28.145051 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.145024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:43:28.163951 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.163920    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:43:28.167900 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.167876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.199548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.199514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:43:28.288286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.288196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76vl2\" (UniqueName: \"kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.288286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.288241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.288499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.288316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.288499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.288404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwvw\" (UniqueName: \"kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.389454 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.389419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.389945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.389480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.389945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.389560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwvw\" (UniqueName: \"kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.389945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.389636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76vl2\" (UniqueName: \"kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.390396 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.390370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.390486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.390412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.411167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.411140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76vl2\" (UniqueName: \"kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2\") pod \"payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.413328 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.413304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwvw\" (UniqueName: \"kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw\") pod \"payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") " pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.446191 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.446156    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.479068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.479030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.623899 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.623867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:43:28.624021 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:43:28.623870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a03363_e8c0_4f41_a17c_31bd8201f9bd.slice/crio-46cf7dabc8d98c61e570f9b00f32b433db8baac7fef4c609e5b3d4f4bd24ebfd WatchSource:0}: Error finding container 46cf7dabc8d98c61e570f9b00f32b433db8baac7fef4c609e5b3d4f4bd24ebfd: Status 404 returned error can't find the container with id 46cf7dabc8d98c61e570f9b00f32b433db8baac7fef4c609e5b3d4f4bd24ebfd
Jul 29 01:43:28.645137 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.645111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:43:28.647503 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:43:28.647473    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee15fc6_97e9_43e6_918f_f51efa80c644.slice/crio-764c753108b733c74788c35100f931cd44502a9d692316808dab0eed43f899e7 WatchSource:0}: Error finding container 764c753108b733c74788c35100f931cd44502a9d692316808dab0eed43f899e7: Status 404 returned error can't find the container with id 764c753108b733c74788c35100f931cd44502a9d692316808dab0eed43f899e7
Jul 29 01:43:28.811908 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.811802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" event={"ID":"0ee15fc6-97e9-43e6-918f-f51efa80c644","Type":"ContainerStarted","Data":"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"}
Jul 29 01:43:28.812065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.811911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" event={"ID":"0ee15fc6-97e9-43e6-918f-f51efa80c644","Type":"ContainerStarted","Data":"764c753108b733c74788c35100f931cd44502a9d692316808dab0eed43f899e7"}
Jul 29 01:43:28.812205 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.812184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:28.813518 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.813496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" event={"ID":"e9a03363-e8c0-4f41-a17c-31bd8201f9bd","Type":"ContainerStarted","Data":"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"}
Jul 29 01:43:28.813662 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.813540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" event={"ID":"e9a03363-e8c0-4f41-a17c-31bd8201f9bd","Type":"ContainerStarted","Data":"46cf7dabc8d98c61e570f9b00f32b433db8baac7fef4c609e5b3d4f4bd24ebfd"}
Jul 29 01:43:28.813662 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.813630    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:43:28.827254 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.827196    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" podStartSLOduration=0.827177814 podStartE2EDuration="827.177814ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:43:28.826193872 +0000 UTC m=+1998.855434788" watchObservedRunningTime="2026-07-29 01:43:28.827177814 +0000 UTC m=+1998.856418729"
Jul 29 01:43:28.845716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:28.845657    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" podStartSLOduration=0.845637935 podStartE2EDuration="845.637935ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:43:28.842493661 +0000 UTC m=+1998.871734574" watchObservedRunningTime="2026-07-29 01:43:28.845637935 +0000 UTC m=+1998.874878849"
Jul 29 01:43:39.821353 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:39.821323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:43:39.821791 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:43:39.821391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:44:08.170352 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.170319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:08.201361 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.201326    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:44:08.201743 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.201698    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" podUID="0ee15fc6-97e9-43e6-918f-f51efa80c644" containerName="payload-processing" containerID="cri-o://838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3" gracePeriod=30
Jul 29 01:44:08.207387 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.207358    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:44:08.207599 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.207557    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" podUID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" containerName="payload-pre-processing" containerID="cri-o://7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b" gracePeriod=30
Jul 29 01:44:08.250601 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.250538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:08.350538 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.350505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:08.428510 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.428432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:08.506155 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.506125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:44:08.511509 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.511407    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:44:08.545425 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume\") pod \"0ee15fc6-97e9-43e6-918f-f51efa80c644\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") "
Jul 29 01:44:08.545659 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkwvw\" (UniqueName: \"kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw\") pod \"0ee15fc6-97e9-43e6-918f-f51efa80c644\" (UID: \"0ee15fc6-97e9-43e6-918f-f51efa80c644\") "
Jul 29 01:44:08.545659 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545494    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume\") pod \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") "
Jul 29 01:44:08.545659 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76vl2\" (UniqueName: \"kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2\") pod \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\" (UID: \"e9a03363-e8c0-4f41-a17c-31bd8201f9bd\") "
Jul 29 01:44:08.545858 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545831    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ee15fc6-97e9-43e6-918f-f51efa80c644" (UID: "0ee15fc6-97e9-43e6-918f-f51efa80c644"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:08.546002 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.545877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9a03363-e8c0-4f41-a17c-31bd8201f9bd" (UID: "e9a03363-e8c0-4f41-a17c-31bd8201f9bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:08.548382 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.548072    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw" (OuterVolumeSpecName: "kube-api-access-zkwvw") pod "0ee15fc6-97e9-43e6-918f-f51efa80c644" (UID: "0ee15fc6-97e9-43e6-918f-f51efa80c644"). InnerVolumeSpecName "kube-api-access-zkwvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:08.548689 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.548655    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2" (OuterVolumeSpecName: "kube-api-access-76vl2") pod "e9a03363-e8c0-4f41-a17c-31bd8201f9bd" (UID: "e9a03363-e8c0-4f41-a17c-31bd8201f9bd"). InnerVolumeSpecName "kube-api-access-76vl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:08.646210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.646169    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.646210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.646201    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76vl2\" (UniqueName: \"kubernetes.io/projected/e9a03363-e8c0-4f41-a17c-31bd8201f9bd-kube-api-access-76vl2\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.646210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.646211    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee15fc6-97e9-43e6-918f-f51efa80c644-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.646210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.646220    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwvw\" (UniqueName: \"kubernetes.io/projected/0ee15fc6-97e9-43e6-918f-f51efa80c644-kube-api-access-zkwvw\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.656640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.656568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:08.797882 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:08.797847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:09.039273 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.039234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:09.054225 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.054128    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" containerID="7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b" exitCode=0
Jul 29 01:44:09.054225 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.054180    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"
Jul 29 01:44:09.054225 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.054204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" event={"ID":"e9a03363-e8c0-4f41-a17c-31bd8201f9bd","Type":"ContainerDied","Data":"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"}
Jul 29 01:44:09.054486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.054257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9" event={"ID":"e9a03363-e8c0-4f41-a17c-31bd8201f9bd","Type":"ContainerDied","Data":"46cf7dabc8d98c61e570f9b00f32b433db8baac7fef4c609e5b3d4f4bd24ebfd"}
Jul 29 01:44:09.054486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.054282    2578 scope.go:117] "RemoveContainer" containerID="7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"
Jul 29 01:44:09.055819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.055793    2578 generic.go:356] "Generic (PLEG): container finished" podID="0ee15fc6-97e9-43e6-918f-f51efa80c644" containerID="838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3" exitCode=0
Jul 29 01:44:09.055964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.055844    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"
Jul 29 01:44:09.055964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.055865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" event={"ID":"0ee15fc6-97e9-43e6-918f-f51efa80c644","Type":"ContainerDied","Data":"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"}
Jul 29 01:44:09.055964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.055904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm" event={"ID":"0ee15fc6-97e9-43e6-918f-f51efa80c644","Type":"ContainerDied","Data":"764c753108b733c74788c35100f931cd44502a9d692316808dab0eed43f899e7"}
Jul 29 01:44:09.066281 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.065862    2578 scope.go:117] "RemoveContainer" containerID="7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"
Jul 29 01:44:09.067857 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:44:09.067819    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b\": container with ID starting with 7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b not found: ID does not exist" containerID="7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"
Jul 29 01:44:09.068070 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.068037    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b"} err="failed to get container status \"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b\": rpc error: code = NotFound desc = could not find container \"7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b\": container with ID starting with 7901d048886b91aca4f7ed5ac79c812081510588fa4c676f96ad26090fb8db1b not found: ID does not exist"
Jul 29 01:44:09.068215 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.068202    2578 scope.go:117] "RemoveContainer" containerID="838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"
Jul 29 01:44:09.078907 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.078886    2578 scope.go:117] "RemoveContainer" containerID="838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"
Jul 29 01:44:09.079309 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:44:09.079277    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3\": container with ID starting with 838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3 not found: ID does not exist" containerID="838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"
Jul 29 01:44:09.079422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.079309    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3"} err="failed to get container status \"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3\": rpc error: code = NotFound desc = could not find container \"838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3\": container with ID starting with 838069588b2f6ad1db697b17a5d5cc25abe24554f3fc1d536299993862f120c3 not found: ID does not exist"
Jul 29 01:44:09.083032 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.083001    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:44:09.088944 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.088912    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a63cc33b-5ff658cdb5-wtpqm"]
Jul 29 01:44:09.100289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.100248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:44:09.105363 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.105333    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a63cc33b-cc5df7d8-kjzj9"]
Jul 29 01:44:09.363803 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.363714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:09.507424 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:09.507383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:10.478619 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:10.478568    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee15fc6-97e9-43e6-918f-f51efa80c644" path="/var/lib/kubelet/pods/0ee15fc6-97e9-43e6-918f-f51efa80c644/volumes"
Jul 29 01:44:10.479001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:10.478980    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" path="/var/lib/kubelet/pods/e9a03363-e8c0-4f41-a17c-31bd8201f9bd/volumes"
Jul 29 01:44:11.975182 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:11.975027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.067452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.067411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.166627 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.166563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.268758 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.268724    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.697068 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.696965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.797357 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.797318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.890116 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:12.890538 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890524    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee15fc6-97e9-43e6-918f-f51efa80c644" containerName="payload-processing"
Jul 29 01:44:12.890598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890539    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee15fc6-97e9-43e6-918f-f51efa80c644" containerName="payload-processing"
Jul 29 01:44:12.890598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890559    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" containerName="payload-pre-processing"
Jul 29 01:44:12.890598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890565    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" containerName="payload-pre-processing"
Jul 29 01:44:12.890698 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890641    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a03363-e8c0-4f41-a17c-31bd8201f9bd" containerName="payload-pre-processing"
Jul 29 01:44:12.890698 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.890653    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee15fc6-97e9-43e6-918f-f51efa80c644" containerName="payload-processing"
Jul 29 01:44:12.893787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.893765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:12.896355 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.896339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0187de68-dockercfg-7b4b7\""
Jul 29 01:44:12.898013 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.897994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0187de68\""
Jul 29 01:44:12.905358 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.905327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:12.960243 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.960159    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:12.964124 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.964095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:12.977618 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.977568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:12.987797 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.987766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:12.987991 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:12.987955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gjdt\" (UniqueName: \"kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.088406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.088366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.088658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.088459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.088658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.088499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5dcl\" (UniqueName: \"kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.088658 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.088520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gjdt\" (UniqueName: \"kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.089252 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.089227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.098678 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.098642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gjdt\" (UniqueName: \"kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt\") pod \"payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.189643 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.189551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.189828 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.189681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5dcl\" (UniqueName: \"kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.190356 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.190336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.198141 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.198100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5dcl\" (UniqueName: \"kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl\") pod \"payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") " pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.206894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.206861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:13.275862 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.275562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:13.389492 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.389458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:13.390849 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:44:13.390823    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff532f11_a689_40b8_b8dd_1224ed344b81.slice/crio-2c98e632ef666ff04f3c48010f5eb390385bb169431e80698f6984a53f0b128c WatchSource:0}: Error finding container 2c98e632ef666ff04f3c48010f5eb390385bb169431e80698f6984a53f0b128c: Status 404 returned error can't find the container with id 2c98e632ef666ff04f3c48010f5eb390385bb169431e80698f6984a53f0b128c
Jul 29 01:44:13.449304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:13.449276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:13.451294 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:44:13.451267    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f14c334_b2b5_49db_be7c_8eee08aa2c08.slice/crio-b452293da3c49031f5b599cafba0af9f2c8471e3e208bf721b809344fca229f6 WatchSource:0}: Error finding container b452293da3c49031f5b599cafba0af9f2c8471e3e208bf721b809344fca229f6: Status 404 returned error can't find the container with id b452293da3c49031f5b599cafba0af9f2c8471e3e208bf721b809344fca229f6
Jul 29 01:44:14.088937 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.088897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" event={"ID":"ff532f11-a689-40b8-b8dd-1224ed344b81","Type":"ContainerStarted","Data":"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"}
Jul 29 01:44:14.089427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.088964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:14.089427 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.088991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" event={"ID":"ff532f11-a689-40b8-b8dd-1224ed344b81","Type":"ContainerStarted","Data":"2c98e632ef666ff04f3c48010f5eb390385bb169431e80698f6984a53f0b128c"}
Jul 29 01:44:14.090495 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.090469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" event={"ID":"6f14c334-b2b5-49db-be7c-8eee08aa2c08","Type":"ContainerStarted","Data":"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"}
Jul 29 01:44:14.090627 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.090511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" event={"ID":"6f14c334-b2b5-49db-be7c-8eee08aa2c08","Type":"ContainerStarted","Data":"b452293da3c49031f5b599cafba0af9f2c8471e3e208bf721b809344fca229f6"}
Jul 29 01:44:14.090627 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.090596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:14.111377 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.111317    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" podStartSLOduration=2.111297453 podStartE2EDuration="2.111297453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:14.109430427 +0000 UTC m=+2044.138671342" watchObservedRunningTime="2026-07-29 01:44:14.111297453 +0000 UTC m=+2044.140538367"
Jul 29 01:44:14.132970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:14.132916    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" podStartSLOduration=2.132898253 podStartE2EDuration="2.132898253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:14.13221767 +0000 UTC m=+2044.161458585" watchObservedRunningTime="2026-07-29 01:44:14.132898253 +0000 UTC m=+2044.162139166"
Jul 29 01:44:25.099481 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:25.099450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:25.099943 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:25.099526    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:42.662818 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.662786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:42.717038 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.717006    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:42.717245 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.717210    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" podUID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" containerName="payload-processing" containerID="cri-o://50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a" gracePeriod=30
Jul 29 01:44:42.725440 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.725405    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:42.726153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.725716    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" podUID="ff532f11-a689-40b8-b8dd-1224ed344b81" containerName="payload-pre-processing" containerID="cri-o://52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6" gracePeriod=30
Jul 29 01:44:42.772340 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.772291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:42.896247 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.895513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:42.988266 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:42.988240    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:43.015871 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.015846    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:43.029864 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.029834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:43.092421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.092379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gjdt\" (UniqueName: \"kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt\") pod \"ff532f11-a689-40b8-b8dd-1224ed344b81\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") "
Jul 29 01:44:43.092421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.092421    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5dcl\" (UniqueName: \"kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl\") pod \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") "
Jul 29 01:44:43.092736 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.092452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume\") pod \"ff532f11-a689-40b8-b8dd-1224ed344b81\" (UID: \"ff532f11-a689-40b8-b8dd-1224ed344b81\") "
Jul 29 01:44:43.092736 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.092467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume\") pod \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\" (UID: \"6f14c334-b2b5-49db-be7c-8eee08aa2c08\") "
Jul 29 01:44:43.092952 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.092923    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff532f11-a689-40b8-b8dd-1224ed344b81" (UID: "ff532f11-a689-40b8-b8dd-1224ed344b81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:43.093219 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.093191    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f14c334-b2b5-49db-be7c-8eee08aa2c08" (UID: "6f14c334-b2b5-49db-be7c-8eee08aa2c08"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:43.100048 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.100012    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl" (OuterVolumeSpecName: "kube-api-access-z5dcl") pod "6f14c334-b2b5-49db-be7c-8eee08aa2c08" (UID: "6f14c334-b2b5-49db-be7c-8eee08aa2c08"). InnerVolumeSpecName "kube-api-access-z5dcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:43.100196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.100088    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt" (OuterVolumeSpecName: "kube-api-access-9gjdt") pod "ff532f11-a689-40b8-b8dd-1224ed344b81" (UID: "ff532f11-a689-40b8-b8dd-1224ed344b81"). InnerVolumeSpecName "kube-api-access-9gjdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:43.194233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.194141    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gjdt\" (UniqueName: \"kubernetes.io/projected/ff532f11-a689-40b8-b8dd-1224ed344b81-kube-api-access-9gjdt\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.194233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.194176    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5dcl\" (UniqueName: \"kubernetes.io/projected/6f14c334-b2b5-49db-be7c-8eee08aa2c08-kube-api-access-z5dcl\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.194233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.194186    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff532f11-a689-40b8-b8dd-1224ed344b81-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.194233 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.194194    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f14c334-b2b5-49db-be7c-8eee08aa2c08-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.265555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.265513    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff532f11-a689-40b8-b8dd-1224ed344b81" containerID="52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6" exitCode=0
Jul 29 01:44:43.265790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.265565    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"
Jul 29 01:44:43.265790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.265603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" event={"ID":"ff532f11-a689-40b8-b8dd-1224ed344b81","Type":"ContainerDied","Data":"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"}
Jul 29 01:44:43.265790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.265662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb" event={"ID":"ff532f11-a689-40b8-b8dd-1224ed344b81","Type":"ContainerDied","Data":"2c98e632ef666ff04f3c48010f5eb390385bb169431e80698f6984a53f0b128c"}
Jul 29 01:44:43.265790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.265691    2578 scope.go:117] "RemoveContainer" containerID="52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"
Jul 29 01:44:43.266994 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.266973    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" containerID="50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a" exitCode=0
Jul 29 01:44:43.267102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.267015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" event={"ID":"6f14c334-b2b5-49db-be7c-8eee08aa2c08","Type":"ContainerDied","Data":"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"}
Jul 29 01:44:43.267102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.267029    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"
Jul 29 01:44:43.267102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.267054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79" event={"ID":"6f14c334-b2b5-49db-be7c-8eee08aa2c08","Type":"ContainerDied","Data":"b452293da3c49031f5b599cafba0af9f2c8471e3e208bf721b809344fca229f6"}
Jul 29 01:44:43.284127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.284102    2578 scope.go:117] "RemoveContainer" containerID="52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"
Jul 29 01:44:43.284437 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:44:43.284418    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6\": container with ID starting with 52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6 not found: ID does not exist" containerID="52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"
Jul 29 01:44:43.284509 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.284446    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6"} err="failed to get container status \"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6\": rpc error: code = NotFound desc = could not find container \"52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6\": container with ID starting with 52b3e4475d78fc8e81aaebf0d33056d825f696a2c73d9fe92ba85185116aa8e6 not found: ID does not exist"
Jul 29 01:44:43.284509 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.284464    2578 scope.go:117] "RemoveContainer" containerID="50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"
Jul 29 01:44:43.293114 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.293082    2578 scope.go:117] "RemoveContainer" containerID="50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"
Jul 29 01:44:43.293385 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:44:43.293366    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a\": container with ID starting with 50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a not found: ID does not exist" containerID="50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"
Jul 29 01:44:43.293431 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.293393    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a"} err="failed to get container status \"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a\": rpc error: code = NotFound desc = could not find container \"50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a\": container with ID starting with 50811eddc128bd156329fbdcfa6674f9b22671e7fa124b75ad0737991618685a not found: ID does not exist"
Jul 29 01:44:43.303132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.303105    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:43.306833 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.306811    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0187de68-6fc4bc8c96-8m9nb"]
Jul 29 01:44:43.330966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.330937    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:43.341286 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:43.341256    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0187de68-5dcdb5954b-fsk79"]
Jul 29 01:44:44.376555 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:44.376521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:44.472206 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:44.472171    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" path="/var/lib/kubelet/pods/6f14c334-b2b5-49db-be7c-8eee08aa2c08/volumes"
Jul 29 01:44:44.472565 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:44.472550    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff532f11-a689-40b8-b8dd-1224ed344b81" path="/var/lib/kubelet/pods/ff532f11-a689-40b8-b8dd-1224ed344b81/volumes"
Jul 29 01:44:44.560709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:44.560668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:45.205192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:45.205141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:45.349548 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:45.349494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:47.653605 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:47.653556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:47.752564 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:47.752531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:47.942339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:47.942246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:48.279129 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.279087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:48.462382 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.462336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:48.565326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.565240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:48.573715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.573684    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:44:48.574125 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574112    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff532f11-a689-40b8-b8dd-1224ed344b81" containerName="payload-pre-processing"
Jul 29 01:44:48.574173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574127    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff532f11-a689-40b8-b8dd-1224ed344b81" containerName="payload-pre-processing"
Jul 29 01:44:48.574173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574138    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" containerName="payload-processing"
Jul 29 01:44:48.574173 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574144    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" containerName="payload-processing"
Jul 29 01:44:48.574264 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574209    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff532f11-a689-40b8-b8dd-1224ed344b81" containerName="payload-pre-processing"
Jul 29 01:44:48.574264 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.574220    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f14c334-b2b5-49db-be7c-8eee08aa2c08" containerName="payload-processing"
Jul 29 01:44:48.579251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.579223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.581406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.581382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ff6a497a\""
Jul 29 01:44:48.581406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.581393    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ff6a497a-dockercfg-r5k5z\""
Jul 29 01:44:48.585620 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.585565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:44:48.612408 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.612365    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:44:48.616920 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.616898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.625968 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.625942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:44:48.648785 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.648746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.648966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.648790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.648966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.648824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rt5x\" (UniqueName: \"kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.648966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.648883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.749792 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.749753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.750210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.749871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.750210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.749892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.750210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.749925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rt5x\" (UniqueName: \"kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.750643 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.750622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.750695 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.750655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.758109 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.758078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rt5x\" (UniqueName: \"kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x\") pod \"payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.758504 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.758479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd\") pod \"payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") " pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:48.893892 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.893803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:48.929637 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:48.929559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:49.104162 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:44:49.104132    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd86231_4c8b_4c9f_836a_eb6e037118bd.slice/crio-6b102c6a1cd9ba18b7976b316776d31581a10a74811eb8b2675a88a13f79ba5a WatchSource:0}: Error finding container 6b102c6a1cd9ba18b7976b316776d31581a10a74811eb8b2675a88a13f79ba5a: Status 404 returned error can't find the container with id 6b102c6a1cd9ba18b7976b316776d31581a10a74811eb8b2675a88a13f79ba5a
Jul 29 01:44:49.104333 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.104310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:44:49.268983 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.268951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:44:49.270805 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:44:49.270775    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df03a92_cde6_4ac7_ac91_7947340b3ba0.slice/crio-e1f19d79299120e4d78b6e5ba696c4e9ddad962713b9cd90ccca63751b73053a WatchSource:0}: Error finding container e1f19d79299120e4d78b6e5ba696c4e9ddad962713b9cd90ccca63751b73053a: Status 404 returned error can't find the container with id e1f19d79299120e4d78b6e5ba696c4e9ddad962713b9cd90ccca63751b73053a
Jul 29 01:44:49.311221 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.311182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" event={"ID":"3df03a92-cde6-4ac7-ac91-7947340b3ba0","Type":"ContainerStarted","Data":"e1f19d79299120e4d78b6e5ba696c4e9ddad962713b9cd90ccca63751b73053a"}
Jul 29 01:44:49.313036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.313005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" event={"ID":"2fd86231-4c8b-4c9f-836a-eb6e037118bd","Type":"ContainerStarted","Data":"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"}
Jul 29 01:44:49.313183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.313070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" event={"ID":"2fd86231-4c8b-4c9f-836a-eb6e037118bd","Type":"ContainerStarted","Data":"6b102c6a1cd9ba18b7976b316776d31581a10a74811eb8b2675a88a13f79ba5a"}
Jul 29 01:44:49.313183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.313165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:44:49.336093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:49.336040    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" podStartSLOduration=1.336019523 podStartE2EDuration="1.336019523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:49.334340431 +0000 UTC m=+2079.363581339" watchObservedRunningTime="2026-07-29 01:44:49.336019523 +0000 UTC m=+2079.365260479"
Jul 29 01:44:50.321461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:50.321418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" event={"ID":"3df03a92-cde6-4ac7-ac91-7947340b3ba0","Type":"ContainerStarted","Data":"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"}
Jul 29 01:44:50.321904 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:50.321672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:44:50.343372 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:44:50.343317    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" podStartSLOduration=2.343300697 podStartE2EDuration="2.343300697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:50.343048613 +0000 UTC m=+2080.372289528" watchObservedRunningTime="2026-07-29 01:44:50.343300697 +0000 UTC m=+2080.372541611"
Jul 29 01:45:00.324326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:00.324289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:45:01.330103 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:01.330070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:45:17.631773 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:17.631728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:17.720093 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:17.720053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:28.596911 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.596873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:28.627542 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.627498    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:45:28.627810 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.627781    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" podUID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" containerName="payload-processing" containerID="cri-o://0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af" gracePeriod=30
Jul 29 01:45:28.634551 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.634521    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:45:28.634787 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.634764    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" podUID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" containerName="payload-pre-processing" containerID="cri-o://b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55" gracePeriod=30
Jul 29 01:45:28.722407 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.722374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:28.898403 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.898367    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:45:28.919378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.919338    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd\") pod \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") "
Jul 29 01:45:28.919595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.919462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume\") pod \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\" (UID: \"2fd86231-4c8b-4c9f-836a-eb6e037118bd\") "
Jul 29 01:45:28.920604 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.920188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2fd86231-4c8b-4c9f-836a-eb6e037118bd" (UID: "2fd86231-4c8b-4c9f-836a-eb6e037118bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:45:28.934957 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.934924    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd" (OuterVolumeSpecName: "kube-api-access-7qpsd") pod "2fd86231-4c8b-4c9f-836a-eb6e037118bd" (UID: "2fd86231-4c8b-4c9f-836a-eb6e037118bd"). InnerVolumeSpecName "kube-api-access-7qpsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:45:28.948044 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:28.948013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:45:29.020838 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.020798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume\") pod \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") "
Jul 29 01:45:29.020838 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.020842    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rt5x\" (UniqueName: \"kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x\") pod \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\" (UID: \"3df03a92-cde6-4ac7-ac91-7947340b3ba0\") "
Jul 29 01:45:29.021229 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.021207    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2fd86231-4c8b-4c9f-836a-eb6e037118bd-kube-api-access-7qpsd\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:45:29.021289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.021237    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd86231-4c8b-4c9f-836a-eb6e037118bd-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:45:29.021289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.021243    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3df03a92-cde6-4ac7-ac91-7947340b3ba0" (UID: "3df03a92-cde6-4ac7-ac91-7947340b3ba0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:45:29.023627 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.023599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x" (OuterVolumeSpecName: "kube-api-access-8rt5x") pod "3df03a92-cde6-4ac7-ac91-7947340b3ba0" (UID: "3df03a92-cde6-4ac7-ac91-7947340b3ba0"). InnerVolumeSpecName "kube-api-access-8rt5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:45:29.122123 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.122032    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3df03a92-cde6-4ac7-ac91-7947340b3ba0-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:45:29.122123 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.122065    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rt5x\" (UniqueName: \"kubernetes.io/projected/3df03a92-cde6-4ac7-ac91-7947340b3ba0-kube-api-access-8rt5x\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:45:29.565973 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.565935    2578 generic.go:356] "Generic (PLEG): container finished" podID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" containerID="b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55" exitCode=0
Jul 29 01:45:29.566160 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.565982    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"
Jul 29 01:45:29.566160 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.566021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" event={"ID":"3df03a92-cde6-4ac7-ac91-7947340b3ba0","Type":"ContainerDied","Data":"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"}
Jul 29 01:45:29.566160 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.566076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp" event={"ID":"3df03a92-cde6-4ac7-ac91-7947340b3ba0","Type":"ContainerDied","Data":"e1f19d79299120e4d78b6e5ba696c4e9ddad962713b9cd90ccca63751b73053a"}
Jul 29 01:45:29.566160 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.566107    2578 scope.go:117] "RemoveContainer" containerID="b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"
Jul 29 01:45:29.567411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.567382    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" containerID="0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af" exitCode=0
Jul 29 01:45:29.567552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.567459    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"
Jul 29 01:45:29.567552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.567464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" event={"ID":"2fd86231-4c8b-4c9f-836a-eb6e037118bd","Type":"ContainerDied","Data":"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"}
Jul 29 01:45:29.567552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.567522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k" event={"ID":"2fd86231-4c8b-4c9f-836a-eb6e037118bd","Type":"ContainerDied","Data":"6b102c6a1cd9ba18b7976b316776d31581a10a74811eb8b2675a88a13f79ba5a"}
Jul 29 01:45:29.577336 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.577316    2578 scope.go:117] "RemoveContainer" containerID="b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"
Jul 29 01:45:29.577736 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:45:29.577704    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55\": container with ID starting with b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55 not found: ID does not exist" containerID="b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"
Jul 29 01:45:29.577867 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.577748    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55"} err="failed to get container status \"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55\": rpc error: code = NotFound desc = could not find container \"b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55\": container with ID starting with b0394350f2d3ef4513d33e917004fae99871b641f797ed12c7c5fa7120440a55 not found: ID does not exist"
Jul 29 01:45:29.577867 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.577773    2578 scope.go:117] "RemoveContainer" containerID="0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"
Jul 29 01:45:29.586804 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.586782    2578 scope.go:117] "RemoveContainer" containerID="0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"
Jul 29 01:45:29.587071 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:45:29.587054    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af\": container with ID starting with 0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af not found: ID does not exist" containerID="0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"
Jul 29 01:45:29.587135 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.587078    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af"} err="failed to get container status \"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af\": rpc error: code = NotFound desc = could not find container \"0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af\": container with ID starting with 0aa532e83d2b0f902d9c01f9556b306e4baf6fef977949f2c207f9a794f6d2af not found: ID does not exist"
Jul 29 01:45:29.592486 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.592459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:45:29.600126 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.600099    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ff6a497a-5dbfb8446d-4k4dp"]
Jul 29 01:45:29.616588 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.616538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:45:29.622054 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.622024    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff6a497a-77948d8cd-gzx8k"]
Jul 29 01:45:29.701852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.701818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:29.811378 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.811344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:29.927406 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:29.927319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:30.007251 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:30.007216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:30.471628 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:30.471594    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" path="/var/lib/kubelet/pods/2fd86231-4c8b-4c9f-836a-eb6e037118bd/volumes"
Jul 29 01:45:30.471976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:30.471963    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" path="/var/lib/kubelet/pods/3df03a92-cde6-4ac7-ac91-7947340b3ba0/volumes"
Jul 29 01:45:31.444640 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:31.444607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:38.610257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:38.610220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:38.717366 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:38.717329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:38.817007 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:38.816980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:38.916371 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:38.916287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:39.347922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:45:39.347882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:05.338376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:05.338294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:11.515916 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:11.515857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:11.621902 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:11.621863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:11.716954 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:11.716920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:15.447546 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:15.447504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:15.834829 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:15.834792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:26.995808 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:26.995767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:27.590771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:27.590735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:33.567125 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:33.567086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:33.667709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:33.667670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:44.048002 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:44.047962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:44.863168 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:44.863128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:51.099942 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:51.099905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:51.213029 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:51.212989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:51.315153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:51.315117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:51.424122 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:46:51.424040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:03.048709 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:03.048674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:03.203803 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:03.203763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:03.375245 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:03.375158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.202814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:05.202779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:11.814992 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:11.814946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:11.933326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:11.933287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:12.432815 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:12.432781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:18.647598 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:18.647546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:18.747231 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:18.747193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:18.902626 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:18.902514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:19.230814 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:19.230716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:19.584863 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:19.584822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:22.514504 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:22.514462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:22.610348 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:22.610302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:22.793932 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:22.793840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:23.167917 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.167814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:23.397665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.397625    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:47:23.398870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.398843    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" containerName="payload-processing"
Jul 29 01:47:23.399047 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.399036    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" containerName="payload-processing"
Jul 29 01:47:23.399176 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.399166    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" containerName="payload-pre-processing"
Jul 29 01:47:23.399249 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.399240    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" containerName="payload-pre-processing"
Jul 29 01:47:23.399516 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.399503    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd86231-4c8b-4c9f-836a-eb6e037118bd" containerName="payload-processing"
Jul 29 01:47:23.399634 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.399622    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df03a92-cde6-4ac7-ac91-7947340b3ba0" containerName="payload-pre-processing"
Jul 29 01:47:23.404255 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.404226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.407949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.407921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-689dd84c\""
Jul 29 01:47:23.407949 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.407944    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-689dd84c-dockercfg-88vq5\""
Jul 29 01:47:23.413780 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.413758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:47:23.422114 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.422047    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:47:23.425852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.425829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.439552 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.439524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:47:23.492945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.492910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.492945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.492953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85smz\" (UniqueName: \"kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.493187 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.492983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.493187 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.493025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dgr\" (UniqueName: \"kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.594514 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.594473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.595043 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.594523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85smz\" (UniqueName: \"kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.595043 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.594569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.595043 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.594623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dgr\" (UniqueName: \"kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.595343 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.595321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.595438 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.595416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.602527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.602491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85smz\" (UniqueName: \"kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz\") pod \"payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.602527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.602512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dgr\" (UniqueName: \"kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr\") pod \"payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") " pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.716849 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.716745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:23.738283 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.738255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:23.900269 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:23.898943    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:47:23.902468 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:47:23.902439    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a454f3_c19d_422d_a728_66ca0d54f518.slice/crio-ae65d4e133ff23d7d44330f72178080b82d6981cd8f19fdf6503a018426363a9 WatchSource:0}: Error finding container ae65d4e133ff23d7d44330f72178080b82d6981cd8f19fdf6503a018426363a9: Status 404 returned error can't find the container with id ae65d4e133ff23d7d44330f72178080b82d6981cd8f19fdf6503a018426363a9
Jul 29 01:47:24.002463 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.002429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:24.099368 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.099316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:24.128843 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.128813    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:47:24.130495 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:47:24.130467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675e95df_e08a_4ce6_b9a8_25a5c84e3b3b.slice/crio-05057fea5a65bcc067b1cd4e4af173726a6ee4378161e879548f37fb138ac77e WatchSource:0}: Error finding container 05057fea5a65bcc067b1cd4e4af173726a6ee4378161e879548f37fb138ac77e: Status 404 returned error can't find the container with id 05057fea5a65bcc067b1cd4e4af173726a6ee4378161e879548f37fb138ac77e
Jul 29 01:47:24.253422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.253318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" event={"ID":"19a454f3-c19d-422d-a728-66ca0d54f518","Type":"ContainerStarted","Data":"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"}
Jul 29 01:47:24.253422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.253383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" event={"ID":"19a454f3-c19d-422d-a728-66ca0d54f518","Type":"ContainerStarted","Data":"ae65d4e133ff23d7d44330f72178080b82d6981cd8f19fdf6503a018426363a9"}
Jul 29 01:47:24.253692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.253507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:24.255035 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.255001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" event={"ID":"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b","Type":"ContainerStarted","Data":"f287803bed1f97834196d1e82cc99d9bce21e0861d7f648fcf28d05fb1af6c21"}
Jul 29 01:47:24.255149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.255051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:24.255149 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.255075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" event={"ID":"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b","Type":"ContainerStarted","Data":"05057fea5a65bcc067b1cd4e4af173726a6ee4378161e879548f37fb138ac77e"}
Jul 29 01:47:24.271179 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.271123    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" podStartSLOduration=1.271107838 podStartE2EDuration="1.271107838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:24.269900077 +0000 UTC m=+2234.299140991" watchObservedRunningTime="2026-07-29 01:47:24.271107838 +0000 UTC m=+2234.300348751"
Jul 29 01:47:24.286931 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:24.286879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" podStartSLOduration=1.286862521 podStartE2EDuration="1.286862521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:24.284379413 +0000 UTC m=+2234.313620328" watchObservedRunningTime="2026-07-29 01:47:24.286862521 +0000 UTC m=+2234.316103435"
Jul 29 01:47:35.263636 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:35.263546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:47:35.264050 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:35.263638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:47:47.459569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:47.459529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:49.740848 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:49.740818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:54.465623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:54.465554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:54.586595 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:47:54.586539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.106737 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.106702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.186265 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.186231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.337764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.337730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.368039 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.367954    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:48:05.368270 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.368242    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" podUID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" containerName="payload-processing" containerID="cri-o://f287803bed1f97834196d1e82cc99d9bce21e0861d7f648fcf28d05fb1af6c21" gracePeriod=30
Jul 29 01:48:05.379922 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.379877    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:48:05.380390 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.380337    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" podUID="19a454f3-c19d-422d-a728-66ca0d54f518" containerName="payload-pre-processing" containerID="cri-o://0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1" gracePeriod=30
Jul 29 01:48:05.433418 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.433384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.499849 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.499811    2578 generic.go:356] "Generic (PLEG): container finished" podID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" containerID="f287803bed1f97834196d1e82cc99d9bce21e0861d7f648fcf28d05fb1af6c21" exitCode=0
Jul 29 01:48:05.500044 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.499846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" event={"ID":"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b","Type":"ContainerDied","Data":"f287803bed1f97834196d1e82cc99d9bce21e0861d7f648fcf28d05fb1af6c21"}
Jul 29 01:48:05.510329 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.510229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.568425 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.568388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:05.679257 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.679223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:48:05.682194 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.682173    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:48:05.802703 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.802674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume\") pod \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") "
Jul 29 01:48:05.802703 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.802711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5dgr\" (UniqueName: \"kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr\") pod \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\" (UID: \"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b\") "
Jul 29 01:48:05.802999 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.802787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume\") pod \"19a454f3-c19d-422d-a728-66ca0d54f518\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") "
Jul 29 01:48:05.802999 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.802872    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85smz\" (UniqueName: \"kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz\") pod \"19a454f3-c19d-422d-a728-66ca0d54f518\" (UID: \"19a454f3-c19d-422d-a728-66ca0d54f518\") "
Jul 29 01:48:05.803178 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.803145    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" (UID: "675e95df-e08a-4ce6-b9a8-25a5c84e3b3b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:48:05.803287 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.803254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19a454f3-c19d-422d-a728-66ca0d54f518" (UID: "19a454f3-c19d-422d-a728-66ca0d54f518"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:48:05.805212 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.805186    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr" (OuterVolumeSpecName: "kube-api-access-c5dgr") pod "675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" (UID: "675e95df-e08a-4ce6-b9a8-25a5c84e3b3b"). InnerVolumeSpecName "kube-api-access-c5dgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:48:05.805317 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.805292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz" (OuterVolumeSpecName: "kube-api-access-85smz") pod "19a454f3-c19d-422d-a728-66ca0d54f518" (UID: "19a454f3-c19d-422d-a728-66ca0d54f518"). InnerVolumeSpecName "kube-api-access-85smz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:48:05.904452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.904357    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.904452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.904391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5dgr\" (UniqueName: \"kubernetes.io/projected/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b-kube-api-access-c5dgr\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.904452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.904400    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19a454f3-c19d-422d-a728-66ca0d54f518-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.904452 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.904408    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85smz\" (UniqueName: \"kubernetes.io/projected/19a454f3-c19d-422d-a728-66ca0d54f518-kube-api-access-85smz\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.928343 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:05.928307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:06.507509 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.507482    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"
Jul 29 01:48:06.508021 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.507483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v" event={"ID":"675e95df-e08a-4ce6-b9a8-25a5c84e3b3b","Type":"ContainerDied","Data":"05057fea5a65bcc067b1cd4e4af173726a6ee4378161e879548f37fb138ac77e"}
Jul 29 01:48:06.508021 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.507630    2578 scope.go:117] "RemoveContainer" containerID="f287803bed1f97834196d1e82cc99d9bce21e0861d7f648fcf28d05fb1af6c21"
Jul 29 01:48:06.509291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.509267    2578 generic.go:356] "Generic (PLEG): container finished" podID="19a454f3-c19d-422d-a728-66ca0d54f518" containerID="0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1" exitCode=0
Jul 29 01:48:06.509420 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.509299    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"
Jul 29 01:48:06.509420 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.509356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" event={"ID":"19a454f3-c19d-422d-a728-66ca0d54f518","Type":"ContainerDied","Data":"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"}
Jul 29 01:48:06.509420 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.509412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8" event={"ID":"19a454f3-c19d-422d-a728-66ca0d54f518","Type":"ContainerDied","Data":"ae65d4e133ff23d7d44330f72178080b82d6981cd8f19fdf6503a018426363a9"}
Jul 29 01:48:06.517959 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.517934    2578 scope.go:117] "RemoveContainer" containerID="0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"
Jul 29 01:48:06.526624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.526594    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:48:06.527520 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.527502    2578 scope.go:117] "RemoveContainer" containerID="0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"
Jul 29 01:48:06.527843 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:48:06.527825    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1\": container with ID starting with 0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1 not found: ID does not exist" containerID="0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"
Jul 29 01:48:06.527903 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.527851    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1"} err="failed to get container status \"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1\": rpc error: code = NotFound desc = could not find container \"0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1\": container with ID starting with 0925e977f33211d84a17bc19cb998595056e9580e5dcfc5b67d4342ced66e1e1 not found: ID does not exist"
Jul 29 01:48:06.529198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.529178    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-689dd84c-5df6b95d8-kv2q8"]
Jul 29 01:48:06.539127 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.539102    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:48:06.542760 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:06.542737    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-689dd84c-6bc84f7586-dgg8v"]
Jul 29 01:48:08.470955 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:08.470925    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a454f3-c19d-422d-a728-66ca0d54f518" path="/var/lib/kubelet/pods/19a454f3-c19d-422d-a728-66ca0d54f518/volumes"
Jul 29 01:48:08.471359 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:08.471291    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" path="/var/lib/kubelet/pods/675e95df-e08a-4ce6-b9a8-25a5c84e3b3b/volumes"
Jul 29 01:48:11.524307 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:11.524274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:11.590569 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:11.590531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:11.834510 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:11.834415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:12.057152 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:12.057119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:12.205391 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:12.205292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:12.309918 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:12.309884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:12.477747 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:12.477654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:18.171111 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:18.171074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:18.276249 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:18.276210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:18.377708 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:18.377679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:18.541740 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:18.541702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:24.437435 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:24.437396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:24.537194 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:24.537156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:31.423611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:31.423546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:31.711705 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:31.711620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:31.810931 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:31.810900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:34.747308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:34.747265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:34.840043 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:34.840016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:34.909284 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:34.909254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:35.221060 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.220967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:35.559166 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.559129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:35.659746 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.659705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:35.700034 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.699993    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:48:35.700721 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700699    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" containerName="payload-processing"
Jul 29 01:48:35.700789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700725    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" containerName="payload-processing"
Jul 29 01:48:35.700789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700750    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a454f3-c19d-422d-a728-66ca0d54f518" containerName="payload-pre-processing"
Jul 29 01:48:35.700789 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700759    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a454f3-c19d-422d-a728-66ca0d54f518" containerName="payload-pre-processing"
Jul 29 01:48:35.700901 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700889    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a454f3-c19d-422d-a728-66ca0d54f518" containerName="payload-pre-processing"
Jul 29 01:48:35.700938 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.700909    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="675e95df-e08a-4ce6-b9a8-25a5c84e3b3b" containerName="payload-processing"
Jul 29 01:48:35.704794 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.704763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.708306 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.708280    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-12321b47\""
Jul 29 01:48:35.708306 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.708303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-12321b47-dockercfg-6l5n2\""
Jul 29 01:48:35.713715 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.713290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:48:35.785337 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.785301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.785809 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.785364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dspx4\" (UniqueName: \"kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.886123 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.886024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.886123 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.886089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dspx4\" (UniqueName: \"kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.886852 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.886829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:35.895913 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:35.895879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dspx4\" (UniqueName: \"kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4\") pod \"payload-processing-e2e-mt-12321b47-77665769b6-55dkm\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") " pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:36.018308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.018267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:36.166477 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.166390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:48:36.169316 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:48:36.169284    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae66ce4_3465_4a1d_9b8f_126ab820ff02.slice/crio-498933181fbc6502da8f6fe7637a9478e827dda0e11f77d68f66469845480582 WatchSource:0}: Error finding container 498933181fbc6502da8f6fe7637a9478e827dda0e11f77d68f66469845480582: Status 404 returned error can't find the container with id 498933181fbc6502da8f6fe7637a9478e827dda0e11f77d68f66469845480582
Jul 29 01:48:36.693192 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.693151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" event={"ID":"8ae66ce4-3465-4a1d-9b8f-126ab820ff02","Type":"ContainerStarted","Data":"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"}
Jul 29 01:48:36.693413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.693255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" event={"ID":"8ae66ce4-3465-4a1d-9b8f-126ab820ff02","Type":"ContainerStarted","Data":"498933181fbc6502da8f6fe7637a9478e827dda0e11f77d68f66469845480582"}
Jul 29 01:48:36.693413 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.693288    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:36.709065 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:36.709003    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" podStartSLOduration=1.7089813230000002 podStartE2EDuration="1.708981323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:36.708052368 +0000 UTC m=+2306.737293275" watchObservedRunningTime="2026-07-29 01:48:36.708981323 +0000 UTC m=+2306.738222238"
Jul 29 01:48:47.702810 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:47.702769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:48:59.792152 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:48:59.792113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:05.785976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:05.785882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:38.059940 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.059899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:38.091258 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.091223    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:49:38.091527 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.091493    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" podUID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" containerName="payload-processing" containerID="cri-o://e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d" gracePeriod=30
Jul 29 01:49:38.135724 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.135688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:38.200499 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.200424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:38.301507 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.301475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:38.351820 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.351788    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:49:38.451802 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.451759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dspx4\" (UniqueName: \"kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4\") pod \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") "
Jul 29 01:49:38.452004 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.451897    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume\") pod \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\" (UID: \"8ae66ce4-3465-4a1d-9b8f-126ab820ff02\") "
Jul 29 01:49:38.452289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.452264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ae66ce4-3465-4a1d-9b8f-126ab820ff02" (UID: "8ae66ce4-3465-4a1d-9b8f-126ab820ff02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:49:38.454042 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.454022    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4" (OuterVolumeSpecName: "kube-api-access-dspx4") pod "8ae66ce4-3465-4a1d-9b8f-126ab820ff02" (UID: "8ae66ce4-3465-4a1d-9b8f-126ab820ff02"). InnerVolumeSpecName "kube-api-access-dspx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:49:38.552788 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.552743    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:49:38.552788 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:38.552780    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dspx4\" (UniqueName: \"kubernetes.io/projected/8ae66ce4-3465-4a1d-9b8f-126ab820ff02-kube-api-access-dspx4\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:49:39.065250 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.065213    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" containerID="e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d" exitCode=0
Jul 29 01:49:39.065716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.065262    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"
Jul 29 01:49:39.065716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.065300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" event={"ID":"8ae66ce4-3465-4a1d-9b8f-126ab820ff02","Type":"ContainerDied","Data":"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"}
Jul 29 01:49:39.065716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.065363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm" event={"ID":"8ae66ce4-3465-4a1d-9b8f-126ab820ff02","Type":"ContainerDied","Data":"498933181fbc6502da8f6fe7637a9478e827dda0e11f77d68f66469845480582"}
Jul 29 01:49:39.065716 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.065390    2578 scope.go:117] "RemoveContainer" containerID="e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"
Jul 29 01:49:39.075571 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.075552    2578 scope.go:117] "RemoveContainer" containerID="e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"
Jul 29 01:49:39.075978 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:49:39.075956    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d\": container with ID starting with e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d not found: ID does not exist" containerID="e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"
Jul 29 01:49:39.076059 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.075987    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d"} err="failed to get container status \"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d\": rpc error: code = NotFound desc = could not find container \"e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d\": container with ID starting with e5553234306a72931ac0781209101b16c9b4cb2557558b547eb1dc077d39b53d not found: ID does not exist"
Jul 29 01:49:39.083424 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.083397    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:49:39.088308 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:39.088286    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12321b47-77665769b6-55dkm"]
Jul 29 01:49:40.470677 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:40.470643    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" path="/var/lib/kubelet/pods/8ae66ce4-3465-4a1d-9b8f-126ab820ff02/volumes"
Jul 29 01:49:41.611842 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:41.611792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:46.630202 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:49:46.630160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:07.849118 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:07.849085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:09.970165 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:09.970131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:11.959229 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:11.959192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:15.489988 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:15.489955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:15.590335 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:15.590303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:16.448891 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:16.448821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:16.541566 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:16.541525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:16.644289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:16.644248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:17.413264 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:17.413226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:17.514973 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:17.514920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:17.616428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:17.616396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:19.082648 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:19.082607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:25.103558 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:25.103519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:25.202284 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:25.202244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:25.777210 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:25.777170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:31.778058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:31.777978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:31.849978 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:31.849943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:31.942948 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:31.942914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:32.046368 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:32.046289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:42.539040 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:42.539009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:42.896438 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:50:42.896335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:03.931136 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:03.931100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:04.064601 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:04.064541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:10.194867 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:10.194818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:10.295107 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:10.295048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:10.547556 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:10.547518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:10.855216 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:10.855124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:11.272200 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:11.272164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:13.523634 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:13.523595    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:13.616894 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:13.616863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:13.795325 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:13.795227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:14.027699 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:14.027661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:14.372870 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:14.372837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:14.530497 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:14.530469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:38.567924 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:38.567884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:38.923672 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:38.923566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:39.257422 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:39.257382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:39.715341 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:39.715263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:42.699957 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.699919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:42.798731 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.798699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:42.874717 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.874683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:51:42.875113 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.875101    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" containerName="payload-processing"
Jul 29 01:51:42.875162 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.875115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" containerName="payload-processing"
Jul 29 01:51:42.875198 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.875185    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae66ce4-3465-4a1d-9b8f-126ab820ff02" containerName="payload-processing"
Jul 29 01:51:42.878445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.878428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:42.880771 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.880748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5ee5b9-serving-cert\""
Jul 29 01:51:42.889289 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.889264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:51:42.907058 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.907021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:42.928670 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.928637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:42.928828 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.928696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-224nv\" (UniqueName: \"kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:42.928828 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:42.928731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.029661 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.029626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-224nv\" (UniqueName: \"kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.029887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.029697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.029887 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.029767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.029887 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:51:43.029873    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-serving-cert: secret "maas-api-e2e-inf-b-5ee5b9-serving-cert" not found
Jul 29 01:51:43.030091 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:51:43.029968    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls podName:876f826e-0dc1-4840-97de-5583c0ea8360 nodeName:}" failed. No retries permitted until 2026-07-29 01:51:43.529944488 +0000 UTC m=+2493.559185387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls") pod "maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" (UID: "876f826e-0dc1-4840-97de-5583c0ea8360") : secret "maas-api-e2e-inf-b-5ee5b9-serving-cert" not found
Jul 29 01:51:43.030597 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.030553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.042955 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.042928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-224nv\" (UniqueName: \"kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.290530 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.290445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:43.446456 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.446424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:43.533656 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.533623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.536376 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.536355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") pod \"maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.629647 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.629517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:43.790500 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.790468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:43.949125 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.949091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:51:43.950654 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:51:43.950624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876f826e_0dc1_4840_97de_5583c0ea8360.slice/crio-81b035f6384f5036ad94d9b7f567023d7e4bd83bcd08685ac9b65107143be39d WatchSource:0}: Error finding container 81b035f6384f5036ad94d9b7f567023d7e4bd83bcd08685ac9b65107143be39d: Status 404 returned error can't find the container with id 81b035f6384f5036ad94d9b7f567023d7e4bd83bcd08685ac9b65107143be39d
Jul 29 01:51:43.951964 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:43.951944    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:51:44.808205 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:44.808167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" event={"ID":"876f826e-0dc1-4840-97de-5583c0ea8360","Type":"ContainerStarted","Data":"b2d5099b01140aca39dbf0509b706d8086512541dcc87fa47486f6130956758e"}
Jul 29 01:51:44.808748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:44.808265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" event={"ID":"876f826e-0dc1-4840-97de-5583c0ea8360","Type":"ContainerStarted","Data":"81b035f6384f5036ad94d9b7f567023d7e4bd83bcd08685ac9b65107143be39d"}
Jul 29 01:51:44.808748 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:44.808294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:51:44.827662 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:44.827608    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" podStartSLOduration=2.505921378 podStartE2EDuration="2.827591405s" totalImagesPullingTime="321.670027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:44.825564442 +0000 UTC m=+2494.854805358" watchObservedRunningTime="2026-07-29 01:51:44.827591405 +0000 UTC m=+2494.856832313"
Jul 29 01:51:50.820807 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:51:50.820778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:52:07.214398 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:52:07.214321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:07.666256 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:52:07.666219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:26.289239 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:52:26.289204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:54.504132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:52:54.504097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:32.356777 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:32.356668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:33.264864 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:33.264826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:43.855268 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:43.855229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:43.951966 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:43.951930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:44.054165 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:44.054127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:44.475772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:44.475734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:50.219451 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:50.219419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:50.288970 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:50.288931    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:50.481218 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:50.481136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:50.730711 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:53:50.730676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.449803 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.449764    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:54:01.450431 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.450032    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" podUID="876f826e-0dc1-4840-97de-5583c0ea8360" containerName="maas-api" containerID="cri-o://b2d5099b01140aca39dbf0509b706d8086512541dcc87fa47486f6130956758e" gracePeriod=30
Jul 29 01:54:01.505318 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.505279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.608895 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.608852    2578 generic.go:356] "Generic (PLEG): container finished" podID="876f826e-0dc1-4840-97de-5583c0ea8360" containerID="b2d5099b01140aca39dbf0509b706d8086512541dcc87fa47486f6130956758e" exitCode=0
Jul 29 01:54:01.609070 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.608917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" event={"ID":"876f826e-0dc1-4840-97de-5583c0ea8360","Type":"ContainerDied","Data":"b2d5099b01140aca39dbf0509b706d8086512541dcc87fa47486f6130956758e"}
Jul 29 01:54:01.614945 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.614906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.715183 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.715118    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:54:01.725610 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.725564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.849784 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.849750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca\") pod \"876f826e-0dc1-4840-97de-5583c0ea8360\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") "
Jul 29 01:54:01.849957 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.849901    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-224nv\" (UniqueName: \"kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv\") pod \"876f826e-0dc1-4840-97de-5583c0ea8360\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") "
Jul 29 01:54:01.850098 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.849959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") pod \"876f826e-0dc1-4840-97de-5583c0ea8360\" (UID: \"876f826e-0dc1-4840-97de-5583c0ea8360\") "
Jul 29 01:54:01.850196 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.850164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "876f826e-0dc1-4840-97de-5583c0ea8360" (UID: "876f826e-0dc1-4840-97de-5583c0ea8360"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:54:01.852489 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.852459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "876f826e-0dc1-4840-97de-5583c0ea8360" (UID: "876f826e-0dc1-4840-97de-5583c0ea8360"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:54:01.852624 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.852509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv" (OuterVolumeSpecName: "kube-api-access-224nv") pod "876f826e-0dc1-4840-97de-5583c0ea8360" (UID: "876f826e-0dc1-4840-97de-5583c0ea8360"). InnerVolumeSpecName "kube-api-access-224nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:54:01.951461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.951419    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-224nv\" (UniqueName: \"kubernetes.io/projected/876f826e-0dc1-4840-97de-5583c0ea8360-kube-api-access-224nv\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:54:01.951461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.951456    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/876f826e-0dc1-4840-97de-5583c0ea8360-maas-api-tls\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:54:01.951461 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:01.951465    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/876f826e-0dc1-4840-97de-5583c0ea8360-openshift-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:54:02.132498 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.132461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:02.616609 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.616570    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"
Jul 29 01:54:02.617037 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.616614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j" event={"ID":"876f826e-0dc1-4840-97de-5583c0ea8360","Type":"ContainerDied","Data":"81b035f6384f5036ad94d9b7f567023d7e4bd83bcd08685ac9b65107143be39d"}
Jul 29 01:54:02.617037 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.616681    2578 scope.go:117] "RemoveContainer" containerID="b2d5099b01140aca39dbf0509b706d8086512541dcc87fa47486f6130956758e"
Jul 29 01:54:02.638060 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.638032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:54:02.640392 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:02.640373    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5ee5b9-86879f57fc-zbz4j"]
Jul 29 01:54:04.470900 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:04.470867    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876f826e-0dc1-4840-97de-5583c0ea8360" path="/var/lib/kubelet/pods/876f826e-0dc1-4840-97de-5583c0ea8360/volumes"
Jul 29 01:54:07.899045 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:07.899011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:07.999695 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:07.999659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:08.166976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:08.166895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:08.396810 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:08.396779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:08.729800 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:08.729770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:08.796772 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:08.796740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:09.118128 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:09.118088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:09.707105 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:09.707042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:11.678651 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:11.678601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:11.777914 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:11.777876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:11.882780 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:11.882743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:11.983639 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:11.983514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:12.524605 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.524538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:12.657730 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.657701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:12.846694 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.846598    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:54:12.847078 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.847018    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876f826e-0dc1-4840-97de-5583c0ea8360" containerName="maas-api"
Jul 29 01:54:12.847078 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.847029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="876f826e-0dc1-4840-97de-5583c0ea8360" containerName="maas-api"
Jul 29 01:54:12.847151 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.847101    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="876f826e-0dc1-4840-97de-5583c0ea8360" containerName="maas-api"
Jul 29 01:54:12.851372 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.851351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:12.853834 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.853807    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2f7b9a\""
Jul 29 01:54:12.853967 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.853886    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2f7b9a-dockercfg-4lhmf\""
Jul 29 01:54:12.858891 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.858860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:54:12.944976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.944932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:12.944976 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:12.944982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccg9t\" (UniqueName: \"kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.046327 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.046287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.046327 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.046333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccg9t\" (UniqueName: \"kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.047074 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.047053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.055419 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.055389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccg9t\" (UniqueName: \"kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t\") pod \"payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.163629 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.163504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.326535 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.326508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:54:13.328263 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:54:13.328240    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53888b4_2d50_4d02_ab11_1bee79dccae2.slice/crio-e61ab7f611edd4b70295b974a52ae2cac76bfbdfc21ce39de07580ddf217db63 WatchSource:0}: Error finding container e61ab7f611edd4b70295b974a52ae2cac76bfbdfc21ce39de07580ddf217db63: Status 404 returned error can't find the container with id e61ab7f611edd4b70295b974a52ae2cac76bfbdfc21ce39de07580ddf217db63
Jul 29 01:54:13.685972 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.685927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" event={"ID":"d53888b4-2d50-4d02-ab11-1bee79dccae2","Type":"ContainerStarted","Data":"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"}
Jul 29 01:54:13.686156 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.685992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" event={"ID":"d53888b4-2d50-4d02-ab11-1bee79dccae2","Type":"ContainerStarted","Data":"e61ab7f611edd4b70295b974a52ae2cac76bfbdfc21ce39de07580ddf217db63"}
Jul 29 01:54:13.686156 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.686020    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:13.703055 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:13.703001    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" podStartSLOduration=1.702984028 podStartE2EDuration="1.702984028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:13.702069445 +0000 UTC m=+2643.731310360" watchObservedRunningTime="2026-07-29 01:54:13.702984028 +0000 UTC m=+2643.732224942"
Jul 29 01:54:24.694744 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:24.694703    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:54:36.663348 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:36.663316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:37.146323 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:37.146282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:37.556323 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:37.556285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:37.658167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:37.658129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:40.587464 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:40.587408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:40.685602 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:40.685539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:41.138994 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.138960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:41.439326 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.439230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:41.696426 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.696321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:41.768153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.768121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:41.807844 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.807813    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:54:41.811683 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.811658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:41.814298 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.814088    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9132e3-dockercfg-7jcfk\""
Jul 29 01:54:41.814410 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.814340    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9132e3\""
Jul 29 01:54:41.821030 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.820284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:54:41.916483 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.916451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9cf6\" (UniqueName: \"kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:41.916665 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:41.916513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.017547 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.017510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9cf6\" (UniqueName: \"kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.017736 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.017598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.018358 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.018336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.025683 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.025592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9cf6\" (UniqueName: \"kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6\") pod \"payload-processing-e2e-api-b-9132e3-7d9459879b-44h76\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") " pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.125890 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.125849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.272260 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.272231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:54:42.274400 ip-10-0-133-32 kubenswrapper[2578]: W0729 01:54:42.274375    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27cfc94b_d2e4_4233_a6ad_bb5dd6dafdc4.slice/crio-e5e1b2629dd740ed85c47fe1532dc4a9931c77c86677e668a1dd9b0cbc826ef1 WatchSource:0}: Error finding container e5e1b2629dd740ed85c47fe1532dc4a9931c77c86677e668a1dd9b0cbc826ef1: Status 404 returned error can't find the container with id e5e1b2629dd740ed85c47fe1532dc4a9931c77c86677e668a1dd9b0cbc826ef1
Jul 29 01:54:42.858921 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.858882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" event={"ID":"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4","Type":"ContainerStarted","Data":"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"}
Jul 29 01:54:42.859339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.858945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" event={"ID":"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4","Type":"ContainerStarted","Data":"e5e1b2629dd740ed85c47fe1532dc4a9931c77c86677e668a1dd9b0cbc826ef1"}
Jul 29 01:54:42.859339 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.858973    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:54:42.876981 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:42.876929    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" podStartSLOduration=1.876910512 podStartE2EDuration="1.876910512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:42.874175304 +0000 UTC m=+2672.903416218" watchObservedRunningTime="2026-07-29 01:54:42.876910512 +0000 UTC m=+2672.906151425"
Jul 29 01:54:53.868018 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:54:53.867980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:55:05.587291 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:05.587195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:24.121535 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.121467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:24.157370 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.157337    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:55:24.157681 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.157622    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" podUID="d53888b4-2d50-4d02-ab11-1bee79dccae2" containerName="payload-processing" containerID="cri-o://931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b" gracePeriod=30
Jul 29 01:55:24.221710 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.221676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:24.310877 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.310842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:24.381484 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.381407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:24.432674 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.432646    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:55:24.509278 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.509242    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccg9t\" (UniqueName: \"kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t\") pod \"d53888b4-2d50-4d02-ab11-1bee79dccae2\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") "
Jul 29 01:55:24.509445 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.509365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume\") pod \"d53888b4-2d50-4d02-ab11-1bee79dccae2\" (UID: \"d53888b4-2d50-4d02-ab11-1bee79dccae2\") "
Jul 29 01:55:24.509764 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.509737    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d53888b4-2d50-4d02-ab11-1bee79dccae2" (UID: "d53888b4-2d50-4d02-ab11-1bee79dccae2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:24.511661 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.511628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t" (OuterVolumeSpecName: "kube-api-access-ccg9t") pod "d53888b4-2d50-4d02-ab11-1bee79dccae2" (UID: "d53888b4-2d50-4d02-ab11-1bee79dccae2"). InnerVolumeSpecName "kube-api-access-ccg9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:24.610430 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.610392    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53888b4-2d50-4d02-ab11-1bee79dccae2-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:55:24.610430 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.610428    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccg9t\" (UniqueName: \"kubernetes.io/projected/d53888b4-2d50-4d02-ab11-1bee79dccae2-kube-api-access-ccg9t\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:55:24.682304 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:24.682204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:25.127967 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.127934    2578 generic.go:356] "Generic (PLEG): container finished" podID="d53888b4-2d50-4d02-ab11-1bee79dccae2" containerID="931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b" exitCode=0
Jul 29 01:55:25.128428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.127983    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"
Jul 29 01:55:25.128428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.128023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" event={"ID":"d53888b4-2d50-4d02-ab11-1bee79dccae2","Type":"ContainerDied","Data":"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"}
Jul 29 01:55:25.128428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.128080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr" event={"ID":"d53888b4-2d50-4d02-ab11-1bee79dccae2","Type":"ContainerDied","Data":"e61ab7f611edd4b70295b974a52ae2cac76bfbdfc21ce39de07580ddf217db63"}
Jul 29 01:55:25.128428 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.128110    2578 scope.go:117] "RemoveContainer" containerID="931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"
Jul 29 01:55:25.138533 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.138508    2578 scope.go:117] "RemoveContainer" containerID="931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"
Jul 29 01:55:25.138885 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:55:25.138865    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b\": container with ID starting with 931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b not found: ID does not exist" containerID="931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"
Jul 29 01:55:25.138969 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.138897    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b"} err="failed to get container status \"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b\": rpc error: code = NotFound desc = could not find container \"931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b\": container with ID starting with 931ca62508b7100262c922b5ce253ace4b886e28d849d7cb6aa176feff80855b not found: ID does not exist"
Jul 29 01:55:25.149868 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.149841    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:55:25.154091 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:25.154067    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f7b9a-d889bc6f4-2ttpr"]
Jul 29 01:55:26.470759 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:26.470721    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53888b4-2d50-4d02-ab11-1bee79dccae2" path="/var/lib/kubelet/pods/d53888b4-2d50-4d02-ab11-1bee79dccae2/volumes"
Jul 29 01:55:27.388987 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:27.388949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:30.577951 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:30.577900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:30.743815 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:30.743780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:30.853369 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:30.853268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:31.085036 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:31.085003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:46.750823 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.750792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:46.788920 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.788887    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:55:46.789209 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.789176    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" podUID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" containerName="payload-processing" containerID="cri-o://a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8" gracePeriod=30
Jul 29 01:55:46.822738 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.822709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:46.922567 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.922535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:46.984705 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:46.984613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:47.056794 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.056771    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:55:47.216414 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.216370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume\") pod \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") "
Jul 29 01:55:47.216611 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.216453    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9cf6\" (UniqueName: \"kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6\") pod \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\" (UID: \"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4\") "
Jul 29 01:55:47.216825 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.216798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" (UID: "27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:47.218775 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.218750    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6" (OuterVolumeSpecName: "kube-api-access-t9cf6") pod "27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" (UID: "27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4"). InnerVolumeSpecName "kube-api-access-t9cf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:47.257528 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.257485    2578 generic.go:356] "Generic (PLEG): container finished" podID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" containerID="a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8" exitCode=0
Jul 29 01:55:47.257819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.257539    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"
Jul 29 01:55:47.257819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.257552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" event={"ID":"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4","Type":"ContainerDied","Data":"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"}
Jul 29 01:55:47.257819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.257641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76" event={"ID":"27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4","Type":"ContainerDied","Data":"e5e1b2629dd740ed85c47fe1532dc4a9931c77c86677e668a1dd9b0cbc826ef1"}
Jul 29 01:55:47.257819 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.257664    2578 scope.go:117] "RemoveContainer" containerID="a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"
Jul 29 01:55:47.277275 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.277253    2578 scope.go:117] "RemoveContainer" containerID="a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"
Jul 29 01:55:47.277656 ip-10-0-133-32 kubenswrapper[2578]: E0729 01:55:47.277635    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8\": container with ID starting with a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8 not found: ID does not exist" containerID="a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"
Jul 29 01:55:47.277719 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.277669    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8"} err="failed to get container status \"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8\": rpc error: code = NotFound desc = could not find container \"a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8\": container with ID starting with a815e01094786716097264ce0512aecdd5bb436fc907e05acc0659f582da6ff8 not found: ID does not exist"
Jul 29 01:55:47.284790 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.284768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:55:47.290651 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.290592    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9132e3-7d9459879b-44h76"]
Jul 29 01:55:47.317623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.317552    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9cf6\" (UniqueName: \"kubernetes.io/projected/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-kube-api-access-t9cf6\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:55:47.317623 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.317622    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 01:55:47.319812 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:47.319787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:48.472153 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:48.472118    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" path="/var/lib/kubelet/pods/27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4/volumes"
Jul 29 01:55:53.085513 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:53.085472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:53.180001 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:53.179971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:53.364448 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:53.364364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:53.582083 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:53.582046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:53.938692 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:53.938650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:54.246685 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:54.246642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:54.418226 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:54.418179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:57.292194 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:57.292165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:57.405180 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:57.405150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:57.473132 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:57.473102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:57.686274 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:57.686198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:58.057412 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:58.057381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:58.154421 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:55:58.154388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:22.217654 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:22.217608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:22.548323 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:22.548291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:22.875477 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:22.875393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:22.976167 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:22.976139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.074481 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.074411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.170411 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.170378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.268213 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.268179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.367968 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.367882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.748838 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.748813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:26.851209 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:26.851178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:51.093147 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:51.093088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:58.682102 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:56:58.682040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:22.020974 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:57:22.020930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:45.983253 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:57:45.983215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:46.095903 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:57:46.095868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:59:43.644857 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:59:43.644815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 01:59:47.189125 ip-10-0-133-32 kubenswrapper[2578]: I0729 01:59:47.189088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:01.590415 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:01:01.590319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:13.060745 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:01:13.060693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:48.768302 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:01:48.768256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:49.682708 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:01:49.682649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:57.184802 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:01:57.184762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:21.605650 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:02:21.605602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:21.617009 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:03:21.616972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:22.496931 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:03:22.496880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:32.190523 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:03:32.190488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:04.605795 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:04:04.605708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:16.115825 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.115788    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240247216"]
Jul 29 02:05:16.116277 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116214    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" containerName="payload-processing"
Jul 29 02:05:16.116277 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116225    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" containerName="payload-processing"
Jul 29 02:05:16.116277 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116241    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53888b4-2d50-4d02-ab11-1bee79dccae2" containerName="payload-processing"
Jul 29 02:05:16.116277 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116247    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53888b4-2d50-4d02-ab11-1bee79dccae2" containerName="payload-processing"
Jul 29 02:05:16.116412 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116312    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53888b4-2d50-4d02-ab11-1bee79dccae2" containerName="payload-processing"
Jul 29 02:05:16.116412 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.116323    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27cfc94b-d2e4-4233-a6ad-bb5dd6dafdc4" containerName="payload-processing"
Jul 29 02:05:16.119633 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.119610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:16.122299 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.122273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wclpv\""
Jul 29 02:05:16.125348 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.125322    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240247216"]
Jul 29 02:05:16.164445 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.164407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jkpt\" (UniqueName: \"kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt\") pod \"test-curl-7844-140687240247216\" (UID: \"12ea987a-b7ba-43c4-aaaf-6b4454e904d6\") " pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:16.265485 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.265448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jkpt\" (UniqueName: \"kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt\") pod \"test-curl-7844-140687240247216\" (UID: \"12ea987a-b7ba-43c4-aaaf-6b4454e904d6\") " pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:16.273986 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.273950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jkpt\" (UniqueName: \"kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt\") pod \"test-curl-7844-140687240247216\" (UID: \"12ea987a-b7ba-43c4-aaaf-6b4454e904d6\") " pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:16.431186 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.431104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:16.581209 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.581181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240247216"]
Jul 29 02:05:16.583019 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:16.582992    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12ea987a_b7ba_43c4_aaaf_6b4454e904d6.slice/crio-5653fc9cafbe1adcf55fa50795f176708483817a03031fb77ba1eed0aae96ad4 WatchSource:0}: Error finding container 5653fc9cafbe1adcf55fa50795f176708483817a03031fb77ba1eed0aae96ad4: Status 404 returned error can't find the container with id 5653fc9cafbe1adcf55fa50795f176708483817a03031fb77ba1eed0aae96ad4
Jul 29 02:05:16.584382 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.584360    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:05:16.630356 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:16.630319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240247216" event={"ID":"12ea987a-b7ba-43c4-aaaf-6b4454e904d6","Type":"ContainerStarted","Data":"5653fc9cafbe1adcf55fa50795f176708483817a03031fb77ba1eed0aae96ad4"}
Jul 29 02:05:17.269490 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:17.269456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:17.638148 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:17.638055    2578 generic.go:356] "Generic (PLEG): container finished" podID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" containerID="554cc714549e0010c2626c5dc27c128a2de3eae3befda14719d7c5def97e2522" exitCode=0
Jul 29 02:05:17.638148 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:17.638106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240247216" event={"ID":"12ea987a-b7ba-43c4-aaaf-6b4454e904d6","Type":"ContainerDied","Data":"554cc714549e0010c2626c5dc27c128a2de3eae3befda14719d7c5def97e2522"}
Jul 29 02:05:18.787266 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.787235    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:18.808402 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.808368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240247216_12ea987a-b7ba-43c4-aaaf-6b4454e904d6/test-curl-7844-140687240247216/0.log"
Jul 29 02:05:18.832169 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.832124    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240247216"]
Jul 29 02:05:18.836373 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.836336    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240247216"]
Jul 29 02:05:18.891434 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.891383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jkpt\" (UniqueName: \"kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt\") pod \"12ea987a-b7ba-43c4-aaaf-6b4454e904d6\" (UID: \"12ea987a-b7ba-43c4-aaaf-6b4454e904d6\") "
Jul 29 02:05:18.893770 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.893698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt" (OuterVolumeSpecName: "kube-api-access-7jkpt") pod "12ea987a-b7ba-43c4-aaaf-6b4454e904d6" (UID: "12ea987a-b7ba-43c4-aaaf-6b4454e904d6"). InnerVolumeSpecName "kube-api-access-7jkpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:18.951090 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.951054    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240200240"]
Jul 29 02:05:18.951489 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.951475    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" containerName="test-curl-7844-140687240247216"
Jul 29 02:05:18.951530 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.951490    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" containerName="test-curl-7844-140687240247216"
Jul 29 02:05:18.951609 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.951597    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" containerName="test-curl-7844-140687240247216"
Jul 29 02:05:18.954785 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.954769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:18.960246 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.960217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240200240"]
Jul 29 02:05:18.992868 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:18.992834    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jkpt\" (UniqueName: \"kubernetes.io/projected/12ea987a-b7ba-43c4-aaaf-6b4454e904d6-kube-api-access-7jkpt\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:19.093671 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.093637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ksk\" (UniqueName: \"kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk\") pod \"test-curl-7844-140687240200240\" (UID: \"d578e2a3-3111-434c-9769-68febba05280\") " pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:19.194317 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.194208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ksk\" (UniqueName: \"kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk\") pod \"test-curl-7844-140687240200240\" (UID: \"d578e2a3-3111-434c-9769-68febba05280\") " pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:19.203941 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.203911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ksk\" (UniqueName: \"kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk\") pod \"test-curl-7844-140687240200240\" (UID: \"d578e2a3-3111-434c-9769-68febba05280\") " pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:19.267342 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.267301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:19.432796 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.432771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240200240"]
Jul 29 02:05:19.434109 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:19.434081    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd578e2a3_3111_434c_9769_68febba05280.slice/crio-b4351ee76e5e81d517c1455f697585fa932b083f7dbc888c7d2ecde5fcc67b8f WatchSource:0}: Error finding container b4351ee76e5e81d517c1455f697585fa932b083f7dbc888c7d2ecde5fcc67b8f: Status 404 returned error can't find the container with id b4351ee76e5e81d517c1455f697585fa932b083f7dbc888c7d2ecde5fcc67b8f
Jul 29 02:05:19.650130 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.650094    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:19.650130 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.650125    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5653fc9cafbe1adcf55fa50795f176708483817a03031fb77ba1eed0aae96ad4"
Jul 29 02:05:19.651551 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:19.651511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240200240" event={"ID":"d578e2a3-3111-434c-9769-68febba05280","Type":"ContainerStarted","Data":"b4351ee76e5e81d517c1455f697585fa932b083f7dbc888c7d2ecde5fcc67b8f"}
Jul 29 02:05:19.660422 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:05:19.660389    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7844-140687240247216\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:20.469703 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:05:20.469656    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7844-140687240247216\" is forbidden: User \"system:node:ip-10-0-133-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-32.ec2.internal' and this object" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" pod="opendatahub/test-curl-7844-140687240247216"
Jul 29 02:05:20.471487 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:20.471463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ea987a-b7ba-43c4-aaaf-6b4454e904d6" path="/var/lib/kubelet/pods/12ea987a-b7ba-43c4-aaaf-6b4454e904d6/volumes"
Jul 29 02:05:20.659318 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:20.659278    2578 generic.go:356] "Generic (PLEG): container finished" podID="d578e2a3-3111-434c-9769-68febba05280" containerID="937265fd29ad601ec9fcdfc0817a5c2062b6cd73ed7026085e37df94f79aae41" exitCode=0
Jul 29 02:05:20.659510 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:20.659366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240200240" event={"ID":"d578e2a3-3111-434c-9769-68febba05280","Type":"ContainerDied","Data":"937265fd29ad601ec9fcdfc0817a5c2062b6cd73ed7026085e37df94f79aae41"}
Jul 29 02:05:21.816753 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.816727    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:21.841289 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.841260    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240200240_d578e2a3-3111-434c-9769-68febba05280/test-curl-7844-140687240200240/0.log"
Jul 29 02:05:21.865843 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.865810    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240200240"]
Jul 29 02:05:21.872075 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.872043    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240200240"]
Jul 29 02:05:21.914359 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.914325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:21.924328 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.924233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6ksk\" (UniqueName: \"kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk\") pod \"d578e2a3-3111-434c-9769-68febba05280\" (UID: \"d578e2a3-3111-434c-9769-68febba05280\") "
Jul 29 02:05:21.926514 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:21.926488    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk" (OuterVolumeSpecName: "kube-api-access-n6ksk") pod "d578e2a3-3111-434c-9769-68febba05280" (UID: "d578e2a3-3111-434c-9769-68febba05280"). InnerVolumeSpecName "kube-api-access-n6ksk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:22.025379 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.025343    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6ksk\" (UniqueName: \"kubernetes.io/projected/d578e2a3-3111-434c-9769-68febba05280-kube-api-access-n6ksk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:22.032324 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.032289    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:22.032802 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.032783    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d578e2a3-3111-434c-9769-68febba05280" containerName="test-curl-7844-140687240200240"
Jul 29 02:05:22.032851 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.032805    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d578e2a3-3111-434c-9769-68febba05280" containerName="test-curl-7844-140687240200240"
Jul 29 02:05:22.032891 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.032881    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d578e2a3-3111-434c-9769-68febba05280" containerName="test-curl-7844-140687240200240"
Jul 29 02:05:22.036014 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.035997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:22.040743 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.040714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:22.125895 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.125858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rlk\" (UniqueName: \"kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk\") pod \"test-curl-7844-140687240312848\" (UID: \"1de002c4-0bc5-4b4d-ae97-080e8a4512af\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:22.226801 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.226710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rlk\" (UniqueName: \"kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk\") pod \"test-curl-7844-140687240312848\" (UID: \"1de002c4-0bc5-4b4d-ae97-080e8a4512af\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:22.236355 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.236330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rlk\" (UniqueName: \"kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk\") pod \"test-curl-7844-140687240312848\" (UID: \"1de002c4-0bc5-4b4d-ae97-080e8a4512af\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:22.347872 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.347830    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:22.472862 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.472825    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d578e2a3-3111-434c-9769-68febba05280" path="/var/lib/kubelet/pods/d578e2a3-3111-434c-9769-68febba05280/volumes"
Jul 29 02:05:22.503229 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.503191    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:22.504690 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:22.504660    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1de002c4_0bc5_4b4d_ae97_080e8a4512af.slice/crio-432491576c06147a5eb8589a107fedb24084bcbe75c6623f02ff677bddfb8c8f WatchSource:0}: Error finding container 432491576c06147a5eb8589a107fedb24084bcbe75c6623f02ff677bddfb8c8f: Status 404 returned error can't find the container with id 432491576c06147a5eb8589a107fedb24084bcbe75c6623f02ff677bddfb8c8f
Jul 29 02:05:22.675675 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.675645    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240200240"
Jul 29 02:05:22.675675 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.675660    2578 scope.go:117] "RemoveContainer" containerID="937265fd29ad601ec9fcdfc0817a5c2062b6cd73ed7026085e37df94f79aae41"
Jul 29 02:05:22.677053 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:22.677022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240312848" event={"ID":"1de002c4-0bc5-4b4d-ae97-080e8a4512af","Type":"ContainerStarted","Data":"432491576c06147a5eb8589a107fedb24084bcbe75c6623f02ff677bddfb8c8f"}
Jul 29 02:05:23.685117 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:23.685077    2578 generic.go:356] "Generic (PLEG): container finished" podID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" containerID="b474c4b6f27b2fd65b85dd73a2839bf11635e024517cb1043bb6e53e4b2c328d" exitCode=0
Jul 29 02:05:23.685536 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:23.685159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240312848" event={"ID":"1de002c4-0bc5-4b4d-ae97-080e8a4512af","Type":"ContainerDied","Data":"b474c4b6f27b2fd65b85dd73a2839bf11635e024517cb1043bb6e53e4b2c328d"}
Jul 29 02:05:24.844272 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.844245    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:24.864012 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.863937    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240312848_1de002c4-0bc5-4b4d-ae97-080e8a4512af/test-curl-7844-140687240312848/0.log"
Jul 29 02:05:24.888529 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.888492    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:24.890939 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.890916    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:24.953794 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.953703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58rlk\" (UniqueName: \"kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk\") pod \"1de002c4-0bc5-4b4d-ae97-080e8a4512af\" (UID: \"1de002c4-0bc5-4b4d-ae97-080e8a4512af\") "
Jul 29 02:05:24.955992 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:24.955958    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk" (OuterVolumeSpecName: "kube-api-access-58rlk") pod "1de002c4-0bc5-4b4d-ae97-080e8a4512af" (UID: "1de002c4-0bc5-4b4d-ae97-080e8a4512af"). InnerVolumeSpecName "kube-api-access-58rlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:25.005827 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.005788    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:25.006218 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.006204    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:25.006292 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.006219    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:25.006346 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.006291    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:25.009418 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.009398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.015854 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.015824    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:25.054966 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.054928    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58rlk\" (UniqueName: \"kubernetes.io/projected/1de002c4-0bc5-4b4d-ae97-080e8a4512af-kube-api-access-58rlk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:25.156038 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.156003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79mj8\" (UniqueName: \"kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8\") pod \"test-curl-7844-140687240312848\" (UID: \"84a0e504-7d30-47f5-80e0-142981e3349f\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.256931 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.256891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79mj8\" (UniqueName: \"kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8\") pod \"test-curl-7844-140687240312848\" (UID: \"84a0e504-7d30-47f5-80e0-142981e3349f\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.265307 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.265275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79mj8\" (UniqueName: \"kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8\") pod \"test-curl-7844-140687240312848\" (UID: \"84a0e504-7d30-47f5-80e0-142981e3349f\") " pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.321141 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.321112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.469547 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.469502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:25.471330 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:25.471302    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84a0e504_7d30_47f5_80e0_142981e3349f.slice/crio-3158fbbef469523eae39fc3aca59c397fe99ad65bda5dcc8b3bdfef92aa81751 WatchSource:0}: Error finding container 3158fbbef469523eae39fc3aca59c397fe99ad65bda5dcc8b3bdfef92aa81751: Status 404 returned error can't find the container with id 3158fbbef469523eae39fc3aca59c397fe99ad65bda5dcc8b3bdfef92aa81751
Jul 29 02:05:25.698444 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.698345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240312848" event={"ID":"84a0e504-7d30-47f5-80e0-142981e3349f","Type":"ContainerStarted","Data":"3158fbbef469523eae39fc3aca59c397fe99ad65bda5dcc8b3bdfef92aa81751"}
Jul 29 02:05:25.699914 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.699893    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="432491576c06147a5eb8589a107fedb24084bcbe75c6623f02ff677bddfb8c8f"
Jul 29 02:05:25.699914 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.699897    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:25.711712 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:25.711671    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7844-140687240312848" oldPodUID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" podUID="84a0e504-7d30-47f5-80e0-142981e3349f"
Jul 29 02:05:26.471761 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:26.471727    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de002c4-0bc5-4b4d-ae97-080e8a4512af" path="/var/lib/kubelet/pods/1de002c4-0bc5-4b4d-ae97-080e8a4512af/volumes"
Jul 29 02:05:26.707141 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:26.707099    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0e504-7d30-47f5-80e0-142981e3349f" containerID="d79ad3ae69edaac183be3d8c24e42eb1bbe7323f23a0283cd8edd69f62e29087" exitCode=0
Jul 29 02:05:26.707341 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:26.707196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240312848" event={"ID":"84a0e504-7d30-47f5-80e0-142981e3349f","Type":"ContainerDied","Data":"d79ad3ae69edaac183be3d8c24e42eb1bbe7323f23a0283cd8edd69f62e29087"}
Jul 29 02:05:27.861775 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.861738    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:27.881484 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.881450    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240312848_84a0e504-7d30-47f5-80e0-142981e3349f/test-curl-7844-140687240312848/0.log"
Jul 29 02:05:27.904647 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.904613    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:27.909752 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.909721    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240312848"]
Jul 29 02:05:27.982315 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.982220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79mj8\" (UniqueName: \"kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8\") pod \"84a0e504-7d30-47f5-80e0-142981e3349f\" (UID: \"84a0e504-7d30-47f5-80e0-142981e3349f\") "
Jul 29 02:05:27.984550 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:27.984521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8" (OuterVolumeSpecName: "kube-api-access-79mj8") pod "84a0e504-7d30-47f5-80e0-142981e3349f" (UID: "84a0e504-7d30-47f5-80e0-142981e3349f"). InnerVolumeSpecName "kube-api-access-79mj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:28.031906 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.031873    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:28.032334 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.032320    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0e504-7d30-47f5-80e0-142981e3349f" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:28.032399 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.032336    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0e504-7d30-47f5-80e0-142981e3349f" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:28.032437 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.032399    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0e504-7d30-47f5-80e0-142981e3349f" containerName="test-curl-7844-140687240312848"
Jul 29 02:05:28.035464 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.035438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:28.040215 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.040186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:28.083495 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.083465    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79mj8\" (UniqueName: \"kubernetes.io/projected/84a0e504-7d30-47f5-80e0-142981e3349f-kube-api-access-79mj8\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:28.184519 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.184477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qq5\" (UniqueName: \"kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5\") pod \"test-curl-7844-140687240313856\" (UID: \"514ee8d9-2a95-477d-9551-afb22bea6082\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:28.285026 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.284976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qq5\" (UniqueName: \"kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5\") pod \"test-curl-7844-140687240313856\" (UID: \"514ee8d9-2a95-477d-9551-afb22bea6082\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:28.294006 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.293981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qq5\" (UniqueName: \"kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5\") pod \"test-curl-7844-140687240313856\" (UID: \"514ee8d9-2a95-477d-9551-afb22bea6082\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:28.347208 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.347168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:28.473278 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.473233    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a0e504-7d30-47f5-80e0-142981e3349f" path="/var/lib/kubelet/pods/84a0e504-7d30-47f5-80e0-142981e3349f/volumes"
Jul 29 02:05:28.493548 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.493515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:28.496114 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:28.496090    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod514ee8d9_2a95_477d_9551_afb22bea6082.slice/crio-6a8f9423c0a954580310f924235819882058702bd70f7bdbbeb3a575502ff45d WatchSource:0}: Error finding container 6a8f9423c0a954580310f924235819882058702bd70f7bdbbeb3a575502ff45d: Status 404 returned error can't find the container with id 6a8f9423c0a954580310f924235819882058702bd70f7bdbbeb3a575502ff45d
Jul 29 02:05:28.722609 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.722329    2578 scope.go:117] "RemoveContainer" containerID="d79ad3ae69edaac183be3d8c24e42eb1bbe7323f23a0283cd8edd69f62e29087"
Jul 29 02:05:28.722609 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.722508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240312848"
Jul 29 02:05:28.724427 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:28.724392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240313856" event={"ID":"514ee8d9-2a95-477d-9551-afb22bea6082","Type":"ContainerStarted","Data":"6a8f9423c0a954580310f924235819882058702bd70f7bdbbeb3a575502ff45d"}
Jul 29 02:05:29.733684 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:29.733648    2578 generic.go:356] "Generic (PLEG): container finished" podID="514ee8d9-2a95-477d-9551-afb22bea6082" containerID="9ed6d26af7f1cf9454b3afec786e0e9e54a89ae75010c5fe8899bcfc470e449c" exitCode=0
Jul 29 02:05:29.734174 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:29.733729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240313856" event={"ID":"514ee8d9-2a95-477d-9551-afb22bea6082","Type":"ContainerDied","Data":"9ed6d26af7f1cf9454b3afec786e0e9e54a89ae75010c5fe8899bcfc470e449c"}
Jul 29 02:05:30.887792 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:30.887761    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:30.907133 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:30.907100    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240313856_514ee8d9-2a95-477d-9551-afb22bea6082/test-curl-7844-140687240313856/0.log"
Jul 29 02:05:30.929378 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:30.929345    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:30.931915 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:30.931890    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:31.014090 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.014059    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5qq5\" (UniqueName: \"kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5\") pod \"514ee8d9-2a95-477d-9551-afb22bea6082\" (UID: \"514ee8d9-2a95-477d-9551-afb22bea6082\") "
Jul 29 02:05:31.016386 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.016352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5" (OuterVolumeSpecName: "kube-api-access-g5qq5") pod "514ee8d9-2a95-477d-9551-afb22bea6082" (UID: "514ee8d9-2a95-477d-9551-afb22bea6082"). InnerVolumeSpecName "kube-api-access-g5qq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:31.048708 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.048671    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:31.049101 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.049088    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514ee8d9-2a95-477d-9551-afb22bea6082" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:31.049144 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.049103    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="514ee8d9-2a95-477d-9551-afb22bea6082" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:31.049189 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.049179    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="514ee8d9-2a95-477d-9551-afb22bea6082" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:31.052243 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.052223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.057103 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.057074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:31.115756 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.115721    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5qq5\" (UniqueName: \"kubernetes.io/projected/514ee8d9-2a95-477d-9551-afb22bea6082-kube-api-access-g5qq5\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:31.216217 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.216177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwkrc\" (UniqueName: \"kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc\") pod \"test-curl-7844-140687240313856\" (UID: \"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.317148 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.317050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwkrc\" (UniqueName: \"kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc\") pod \"test-curl-7844-140687240313856\" (UID: \"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.326208 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.326176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwkrc\" (UniqueName: \"kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc\") pod \"test-curl-7844-140687240313856\" (UID: \"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd\") " pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.362815 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.362789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.527062 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.527029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:31.527470 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:31.527446    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f0830c2_3b2c_4bfe_90b5_d6c83de928fd.slice/crio-9defa523747d36fc5c105a708456fe667a3a8741911e72b38cfd961fcccfb13b WatchSource:0}: Error finding container 9defa523747d36fc5c105a708456fe667a3a8741911e72b38cfd961fcccfb13b: Status 404 returned error can't find the container with id 9defa523747d36fc5c105a708456fe667a3a8741911e72b38cfd961fcccfb13b
Jul 29 02:05:31.747092 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.747060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240313856" event={"ID":"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd","Type":"ContainerStarted","Data":"9defa523747d36fc5c105a708456fe667a3a8741911e72b38cfd961fcccfb13b"}
Jul 29 02:05:31.748315 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.748298    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:31.748449 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.748352    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a8f9423c0a954580310f924235819882058702bd70f7bdbbeb3a575502ff45d"
Jul 29 02:05:31.760047 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:31.760018    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7844-140687240313856" oldPodUID="514ee8d9-2a95-477d-9551-afb22bea6082" podUID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd"
Jul 29 02:05:32.471206 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:32.471171    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514ee8d9-2a95-477d-9551-afb22bea6082" path="/var/lib/kubelet/pods/514ee8d9-2a95-477d-9551-afb22bea6082/volumes"
Jul 29 02:05:32.755928 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:32.755890    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" containerID="377e9f7f2ccc40e12c52308a3dab13d0b35cb4f71e9b46e4e27556e981c18182" exitCode=0
Jul 29 02:05:32.756151 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:32.755979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7844-140687240313856" event={"ID":"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd","Type":"ContainerDied","Data":"377e9f7f2ccc40e12c52308a3dab13d0b35cb4f71e9b46e4e27556e981c18182"}
Jul 29 02:05:33.913181 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:33.913156    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:33.933067 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:33.933029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7844-140687240313856_6f0830c2-3b2c-4bfe-90b5-d6c83de928fd/test-curl-7844-140687240313856/0.log"
Jul 29 02:05:33.960067 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:33.960028    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:33.965503 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:33.965449    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7844-140687240313856"]
Jul 29 02:05:34.042636 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.042526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwkrc\" (UniqueName: \"kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc\") pod \"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd\" (UID: \"6f0830c2-3b2c-4bfe-90b5-d6c83de928fd\") "
Jul 29 02:05:34.044894 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.044853    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc" (OuterVolumeSpecName: "kube-api-access-xwkrc") pod "6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" (UID: "6f0830c2-3b2c-4bfe-90b5-d6c83de928fd"). InnerVolumeSpecName "kube-api-access-xwkrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:34.143819 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.143782    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwkrc\" (UniqueName: \"kubernetes.io/projected/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd-kube-api-access-xwkrc\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:05:34.471235 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.471148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:34.472161 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.472134    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" path="/var/lib/kubelet/pods/6f0830c2-3b2c-4bfe-90b5-d6c83de928fd/volumes"
Jul 29 02:05:34.769742 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.769707    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7844-140687240313856"
Jul 29 02:05:34.769942 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.769746    2578 scope.go:117] "RemoveContainer" containerID="377e9f7f2ccc40e12c52308a3dab13d0b35cb4f71e9b46e4e27556e981c18182"
Jul 29 02:05:34.867011 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:34.866971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:35.311596 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:35.311547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:37.714955 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.714919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:37.788273 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.788237    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:05:37.788733 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.788717    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:37.788814 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.788734    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:37.788814 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.788812    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f0830c2-3b2c-4bfe-90b5-d6c83de928fd" containerName="test-curl-7844-140687240313856"
Jul 29 02:05:37.792022 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.791998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.794189 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.794166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-74cb2e-serving-cert\""
Jul 29 02:05:37.803403 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.803376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:05:37.807944 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.807905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:37.877106 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.877071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.877106 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.877112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smtj\" (UniqueName: \"kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.877343 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.877210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.886405 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.886374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:37.978037 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.977927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.978252 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.978038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.978252 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.978082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smtj\" (UniqueName: \"kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.978252 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:05:37.978093    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-serving-cert: secret "maas-api-e2e-ipp-a-74cb2e-serving-cert" not found
Jul 29 02:05:37.978252 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:05:37.978207    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls podName:1af53a5d-25b4-43ee-bd36-997136aed282 nodeName:}" failed. No retries permitted until 2026-07-29 02:05:38.478165982 +0000 UTC m=+3328.507406880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls") pod "maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" (UID: "1af53a5d-25b4-43ee-bd36-997136aed282") : secret "maas-api-e2e-ipp-a-74cb2e-serving-cert" not found
Jul 29 02:05:37.978846 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.978819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:37.989996 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:37.989966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smtj\" (UniqueName: \"kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:38.188083 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.188051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:38.386174 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.386134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:38.481036 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.481002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:38.483642 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.483247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:38.486094 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.486069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") pod \"maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:38.486496 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.486477    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:05:38.488922 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.488906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.491324 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.491302    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-74cb2e\""
Jul 29 02:05:38.500064 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.499998    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:05:38.527851 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.527815    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:05:38.531028 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.531007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.533507 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.533483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-74cb2e-dockercfg-vtcz6\""
Jul 29 02:05:38.541398 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.541371    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:05:38.583949 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.583908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.583949 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.583951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb886\" (UniqueName: \"kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.584198 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.584020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59z6\" (UniqueName: \"kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.584198 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.584104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.684964 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.684864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.684964 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.684912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb886\" (UniqueName: \"kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.684964 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.684943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59z6\" (UniqueName: \"kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.685213 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.684980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.685641 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.685617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.685696 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.685675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.693329 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.693299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59z6\" (UniqueName: \"kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6\") pod \"payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.693453 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.693311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb886\" (UniqueName: \"kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886\") pod \"payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.705259 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.705219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:38.809649 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.809538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:38.842845 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.842799    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:38.861446 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:38.861396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:05:38.863427 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:38.863362    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af53a5d_25b4_43ee_bd36_997136aed282.slice/crio-56b0f152a455a9fb1df1e7744e82886ff6488ec4882476205118358d65156c0a WatchSource:0}: Error finding container 56b0f152a455a9fb1df1e7744e82886ff6488ec4882476205118358d65156c0a: Status 404 returned error can't find the container with id 56b0f152a455a9fb1df1e7744e82886ff6488ec4882476205118358d65156c0a
Jul 29 02:05:39.011809 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.011712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:05:39.013608 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:39.013552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27d28dc_86a1_4600_a752_f8ebd01ad770.slice/crio-df5a5acda307e705bfacf87055c8904a862add82bc6506683b65619aff1ddb3c WatchSource:0}: Error finding container df5a5acda307e705bfacf87055c8904a862add82bc6506683b65619aff1ddb3c: Status 404 returned error can't find the container with id df5a5acda307e705bfacf87055c8904a862add82bc6506683b65619aff1ddb3c
Jul 29 02:05:39.248162 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.248129    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:05:39.249718 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:05:39.249693    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7221ff9_1976_419b_92cc_b3323413e024.slice/crio-ebe18f696d9c5efd440593973fb246f4456326bd4343ab1dbeea63fe8134e5c5 WatchSource:0}: Error finding container ebe18f696d9c5efd440593973fb246f4456326bd4343ab1dbeea63fe8134e5c5: Status 404 returned error can't find the container with id ebe18f696d9c5efd440593973fb246f4456326bd4343ab1dbeea63fe8134e5c5
Jul 29 02:05:39.809929 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.809881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" event={"ID":"d27d28dc-86a1-4600-a752-f8ebd01ad770","Type":"ContainerStarted","Data":"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"}
Jul 29 02:05:39.810404 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.809943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" event={"ID":"d27d28dc-86a1-4600-a752-f8ebd01ad770","Type":"ContainerStarted","Data":"df5a5acda307e705bfacf87055c8904a862add82bc6506683b65619aff1ddb3c"}
Jul 29 02:05:39.810404 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.810096    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:39.811648 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.811621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" event={"ID":"1af53a5d-25b4-43ee-bd36-997136aed282","Type":"ContainerStarted","Data":"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"}
Jul 29 02:05:39.811795 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.811687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" event={"ID":"1af53a5d-25b4-43ee-bd36-997136aed282","Type":"ContainerStarted","Data":"56b0f152a455a9fb1df1e7744e82886ff6488ec4882476205118358d65156c0a"}
Jul 29 02:05:39.811795 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.811717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:39.813359 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.813337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" event={"ID":"b7221ff9-1976-419b-92cc-b3323413e024","Type":"ContainerStarted","Data":"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"}
Jul 29 02:05:39.813460 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.813372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" event={"ID":"b7221ff9-1976-419b-92cc-b3323413e024","Type":"ContainerStarted","Data":"ebe18f696d9c5efd440593973fb246f4456326bd4343ab1dbeea63fe8134e5c5"}
Jul 29 02:05:39.813460 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.813422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:05:39.827436 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.827378    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" podStartSLOduration=1.8273589449999998 podStartE2EDuration="1.827358945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:05:39.82470567 +0000 UTC m=+3329.853946586" watchObservedRunningTime="2026-07-29 02:05:39.827358945 +0000 UTC m=+3329.856599859"
Jul 29 02:05:39.843505 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.843446    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" podStartSLOduration=2.372678608 podStartE2EDuration="2.843431883s" totalImagesPullingTime="470.753275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:05:39.841512382 +0000 UTC m=+3329.870753310" watchObservedRunningTime="2026-07-29 02:05:39.843431883 +0000 UTC m=+3329.872672819"
Jul 29 02:05:39.857403 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:39.857349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" podStartSLOduration=1.8573309770000002 podStartE2EDuration="1.857330977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:05:39.85616598 +0000 UTC m=+3329.885406909" watchObservedRunningTime="2026-07-29 02:05:39.857330977 +0000 UTC m=+3329.886571892"
Jul 29 02:05:45.826695 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:45.826667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:05:50.822731 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:50.822699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:05:50.823157 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:05:50.822784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:06:02.710484 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:02.710451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:03.361837 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:03.361796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:03.678936 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:03.678846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:04.776683 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:04.776646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:06.838355 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:06.838321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:06.940927 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:06.940897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:07.069597 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.069547    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:06:07.075004 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.074978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.077410 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.077388    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-e02970-serving-cert\""
Jul 29 02:06:07.085696 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.085623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:06:07.102316 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.102221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:07.169430 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.169385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.169695 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.169552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctpk\" (UniqueName: \"kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.169767 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.169702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.270657 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.270571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.270849 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.270671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.270849 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.270781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gctpk\" (UniqueName: \"kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.270849 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:06:07.270829    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-serving-cert: secret "maas-api-e2e-ipp-b-e02970-serving-cert" not found
Jul 29 02:06:07.270991 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:06:07.270910    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls podName:d3d984cd-3a78-47f1-a6cf-1752481ed2ef nodeName:}" failed. No retries permitted until 2026-07-29 02:06:07.770887356 +0000 UTC m=+3357.800128247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls") pod "maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" (UID: "d3d984cd-3a78-47f1-a6cf-1752481ed2ef") : secret "maas-api-e2e-ipp-b-e02970-serving-cert" not found
Jul 29 02:06:07.271328 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.271308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.280993 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.280958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctpk\" (UniqueName: \"kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.483658 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.483531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:07.774100 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.774060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:07.775117 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.775097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.778470 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.778430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:07.925071 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.925037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:07.988041 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:07.987998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:08.154224 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:08.154198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:06:08.155965 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:06:08.155937    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d984cd_3a78_47f1_a6cf_1752481ed2ef.slice/crio-25136aaef2f4d15b169febedcd37ed99e6e695e241a8405074728a0ca7f2bc97 WatchSource:0}: Error finding container 25136aaef2f4d15b169febedcd37ed99e6e695e241a8405074728a0ca7f2bc97: Status 404 returned error can't find the container with id 25136aaef2f4d15b169febedcd37ed99e6e695e241a8405074728a0ca7f2bc97
Jul 29 02:06:09.014253 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:09.014218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" event={"ID":"d3d984cd-3a78-47f1-a6cf-1752481ed2ef","Type":"ContainerStarted","Data":"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"}
Jul 29 02:06:09.014709 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:09.014295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" event={"ID":"d3d984cd-3a78-47f1-a6cf-1752481ed2ef","Type":"ContainerStarted","Data":"25136aaef2f4d15b169febedcd37ed99e6e695e241a8405074728a0ca7f2bc97"}
Jul 29 02:06:09.014709 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:09.014392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:09.031779 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:09.031725    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" podStartSLOduration=1.7146277840000002 podStartE2EDuration="2.03170981s" totalImagesPullingTime="317.082026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:06:09.030357702 +0000 UTC m=+3359.059598618" watchObservedRunningTime="2026-07-29 02:06:09.03170981 +0000 UTC m=+3359.060950768"
Jul 29 02:06:15.031794 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:15.031755    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:06:31.825862 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:31.825824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:33.669719 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.669683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:33.673368 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.673343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:33.683670 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.683607    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:33.816268 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.816232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrtzp\" (UniqueName: \"kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp\") pod \"kuadrant-operator-catalog-tk67s\" (UID: \"3d8a8fdb-6d59-44c8-a564-c333844c86da\") " pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:33.917295 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.917249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrtzp\" (UniqueName: \"kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp\") pod \"kuadrant-operator-catalog-tk67s\" (UID: \"3d8a8fdb-6d59-44c8-a564-c333844c86da\") " pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:33.927378 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.927311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrtzp\" (UniqueName: \"kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp\") pod \"kuadrant-operator-catalog-tk67s\" (UID: \"3d8a8fdb-6d59-44c8-a564-c333844c86da\") " pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:33.985341 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:33.985303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:34.143353 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:34.143325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:34.144639 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:06:34.144558    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8a8fdb_6d59_44c8_a564_c333844c86da.slice/crio-6dd57546149e6d79afb928f4cf82478e6fde4a08b56cd915d7151e5e47513098 WatchSource:0}: Error finding container 6dd57546149e6d79afb928f4cf82478e6fde4a08b56cd915d7151e5e47513098: Status 404 returned error can't find the container with id 6dd57546149e6d79afb928f4cf82478e6fde4a08b56cd915d7151e5e47513098
Jul 29 02:06:34.178271 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:34.178180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" event={"ID":"3d8a8fdb-6d59-44c8-a564-c333844c86da","Type":"ContainerStarted","Data":"6dd57546149e6d79afb928f4cf82478e6fde4a08b56cd915d7151e5e47513098"}
Jul 29 02:06:35.187272 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:35.187236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" event={"ID":"3d8a8fdb-6d59-44c8-a564-c333844c86da","Type":"ContainerStarted","Data":"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"}
Jul 29 02:06:35.206797 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:35.206742    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" podStartSLOduration=1.314391352 podStartE2EDuration="2.206723616s" totalImagesPullingTime="892.332264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:06:35.20391696 +0000 UTC m=+3385.233157874" watchObservedRunningTime="2026-07-29 02:06:35.206723616 +0000 UTC m=+3385.235964531"
Jul 29 02:06:35.971871 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:35.971832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:38.688482 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:38.688452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:06:43.986426 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:43.986380    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:43.986876 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:43.986488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:44.013783 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:44.013755    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:44.263850 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:44.263825    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:44.301668 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:44.301634    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:46.253842 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:46.253799    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" podUID="3d8a8fdb-6d59-44c8-a564-c333844c86da" containerName="registry-server" containerID="cri-o://92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3" gracePeriod=2
Jul 29 02:06:46.519527 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:46.519451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:46.643453 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:46.643414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrtzp\" (UniqueName: \"kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp\") pod \"3d8a8fdb-6d59-44c8-a564-c333844c86da\" (UID: \"3d8a8fdb-6d59-44c8-a564-c333844c86da\") "
Jul 29 02:06:46.645725 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:46.645699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp" (OuterVolumeSpecName: "kube-api-access-nrtzp") pod "3d8a8fdb-6d59-44c8-a564-c333844c86da" (UID: "3d8a8fdb-6d59-44c8-a564-c333844c86da"). InnerVolumeSpecName "kube-api-access-nrtzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:06:46.744603 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:46.744539    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrtzp\" (UniqueName: \"kubernetes.io/projected/3d8a8fdb-6d59-44c8-a564-c333844c86da-kube-api-access-nrtzp\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:06:47.261226 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.261193    2578 generic.go:356] "Generic (PLEG): container finished" podID="3d8a8fdb-6d59-44c8-a564-c333844c86da" containerID="92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3" exitCode=0
Jul 29 02:06:47.261760 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.261250    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tk67s"
Jul 29 02:06:47.261760 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.261284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" event={"ID":"3d8a8fdb-6d59-44c8-a564-c333844c86da","Type":"ContainerDied","Data":"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"}
Jul 29 02:06:47.261760 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.261344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tk67s" event={"ID":"3d8a8fdb-6d59-44c8-a564-c333844c86da","Type":"ContainerDied","Data":"6dd57546149e6d79afb928f4cf82478e6fde4a08b56cd915d7151e5e47513098"}
Jul 29 02:06:47.261760 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.261373    2578 scope.go:117] "RemoveContainer" containerID="92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"
Jul 29 02:06:47.272827 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.272802    2578 scope.go:117] "RemoveContainer" containerID="92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"
Jul 29 02:06:47.273171 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:06:47.273137    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3\": container with ID starting with 92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3 not found: ID does not exist" containerID="92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"
Jul 29 02:06:47.273235 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.273180    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3"} err="failed to get container status \"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3\": rpc error: code = NotFound desc = could not find container \"92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3\": container with ID starting with 92362c1966e1d01b7cfb5b0913b12c005b5067f2f75b3fad9723063bacbc1bf3 not found: ID does not exist"
Jul 29 02:06:47.283493 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.283460    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:47.289054 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:47.289027    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tk67s"]
Jul 29 02:06:48.472462 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:48.472432    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8a8fdb-6d59-44c8-a564-c333844c86da" path="/var/lib/kubelet/pods/3d8a8fdb-6d59-44c8-a564-c333844c86da/volumes"
Jul 29 02:06:50.358461 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:06:50.358427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:08.266237 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:08.266134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:35.946884 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:35.946853    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b_b7221ff9-1976-419b-92cc-b3323413e024/payload-processing/0.log"
Jul 29 02:07:36.068907 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:36.068879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:07:36.472038 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:36.471996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:36.916811 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:36.916766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:36.973742 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:36.973706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:39.335763 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.335725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:39.464950 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.464908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:39.499349 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.499307    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:07:39.500021 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.499999    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8a8fdb-6d59-44c8-a564-c333844c86da" containerName="registry-server"
Jul 29 02:07:39.500121 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.500024    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8a8fdb-6d59-44c8-a564-c333844c86da" containerName="registry-server"
Jul 29 02:07:39.500189 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.500175    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8a8fdb-6d59-44c8-a564-c333844c86da" containerName="registry-server"
Jul 29 02:07:39.503979 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.503957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.507097 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.507074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-5be2ca-serving-cert\""
Jul 29 02:07:39.513169 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.513141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:07:39.549240 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.549204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:39.553860 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.553834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgkx\" (UniqueName: \"kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.553982 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.553868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.554022 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.554008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.655414 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.655299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.655414 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.655381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgkx\" (UniqueName: \"kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.655414 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.655409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.656007 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.655977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.658096 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.658066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.670855 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.670818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgkx\" (UniqueName: \"kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx\") pod \"maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.671562 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.671539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:39.816593 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.816529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:39.993179 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:39.993153    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:07:39.995681 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:07:39.995642    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b350a75_b4c1_4e6e_a2f6_b4b635c736d4.slice/crio-aa4c55b0d033dac5b833db751dbdc5dc1426125a7c30874aa23527e4207ff8dd WatchSource:0}: Error finding container aa4c55b0d033dac5b833db751dbdc5dc1426125a7c30874aa23527e4207ff8dd: Status 404 returned error can't find the container with id aa4c55b0d033dac5b833db751dbdc5dc1426125a7c30874aa23527e4207ff8dd
Jul 29 02:07:40.238254 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.238148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:40.338002 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.337966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:40.406138 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.406103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:07:40.409771 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.409750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.412081 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.412059    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-5be2ca\""
Jul 29 02:07:40.412198 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.412126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-5be2ca-dockercfg-rb555\""
Jul 29 02:07:40.419740 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.419712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:07:40.461790 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.461764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mfn\" (UniqueName: \"kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.461954 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.461795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.562409 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.562369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mfn\" (UniqueName: \"kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.562409 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.562411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.563246 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.563214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.571801 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.571772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mfn\" (UniqueName: \"kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn\") pod \"payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:40.602417 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.602245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" event={"ID":"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4","Type":"ContainerStarted","Data":"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"}
Jul 29 02:07:40.602417 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.602356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" event={"ID":"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4","Type":"ContainerStarted","Data":"aa4c55b0d033dac5b833db751dbdc5dc1426125a7c30874aa23527e4207ff8dd"}
Jul 29 02:07:40.602807 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.602512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:40.618976 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.618897    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" podStartSLOduration=1.196770297 podStartE2EDuration="1.618873393s" totalImagesPullingTime="422.103096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:07:40.618311033 +0000 UTC m=+3450.647551949" watchObservedRunningTime="2026-07-29 02:07:40.618873393 +0000 UTC m=+3450.648114308"
Jul 29 02:07:40.723497 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:40.723458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:41.093094 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:41.093063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:07:41.094946 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:07:41.094913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e612b1_6240_4da3_8367_b22f70ebeaff.slice/crio-c24f5e3436b7da16603e8ec93843e77572e8552a01b0c415f7cadb3c40e28308 WatchSource:0}: Error finding container c24f5e3436b7da16603e8ec93843e77572e8552a01b0c415f7cadb3c40e28308: Status 404 returned error can't find the container with id c24f5e3436b7da16603e8ec93843e77572e8552a01b0c415f7cadb3c40e28308
Jul 29 02:07:41.612046 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:41.611999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" event={"ID":"d8e612b1-6240-4da3-8367-b22f70ebeaff","Type":"ContainerStarted","Data":"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"}
Jul 29 02:07:41.612524 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:41.612074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" event={"ID":"d8e612b1-6240-4da3-8367-b22f70ebeaff","Type":"ContainerStarted","Data":"c24f5e3436b7da16603e8ec93843e77572e8552a01b0c415f7cadb3c40e28308"}
Jul 29 02:07:41.612524 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:41.612106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:07:41.630658 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:41.630600    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" podStartSLOduration=1.6305667160000001 podStartE2EDuration="1.630566716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:07:41.628383242 +0000 UTC m=+3451.657624156" watchObservedRunningTime="2026-07-29 02:07:41.630566716 +0000 UTC m=+3451.659807679"
Jul 29 02:07:42.434551 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:42.434514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:42.492742 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:42.492683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:46.618219 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:46.618183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:07:52.622543 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:07:52.622509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:08:04.298500 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:04.298458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:09.994504 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:09.994457    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:08:09.995020 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:09.994752    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" podUID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" containerName="maas-api" containerID="cri-o://e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718" gracePeriod=30
Jul 29 02:08:10.015832 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.015797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:10.052923 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.052890    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:08:10.053139 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.053113    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" podUID="d8e612b1-6240-4da3-8367-b22f70ebeaff" containerName="payload-pre-processing" containerID="cri-o://ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7" gracePeriod=30
Jul 29 02:08:10.115787 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.115742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:10.193766 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.193717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:10.261954 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.261926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:08:10.267511 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.267473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:10.332642 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.332605    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:08:10.342795 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.342766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzgkx\" (UniqueName: \"kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx\") pod \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") "
Jul 29 02:08:10.342952 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.342804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca\") pod \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") "
Jul 29 02:08:10.342952 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.342902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls\") pod \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\" (UID: \"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4\") "
Jul 29 02:08:10.343176 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.343154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" (UID: "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:10.345324 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.345288    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx" (OuterVolumeSpecName: "kube-api-access-tzgkx") pod "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" (UID: "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4"). InnerVolumeSpecName "kube-api-access-tzgkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:10.345472 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.345367    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" (UID: "6b350a75-b4c1-4e6e-a2f6-b4b635c736d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:08:10.444405 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume\") pod \"d8e612b1-6240-4da3-8367-b22f70ebeaff\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") "
Jul 29 02:08:10.444705 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mfn\" (UniqueName: \"kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn\") pod \"d8e612b1-6240-4da3-8367-b22f70ebeaff\" (UID: \"d8e612b1-6240-4da3-8367-b22f70ebeaff\") "
Jul 29 02:08:10.444705 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444703    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-maas-api-tls\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:10.444794 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444716    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzgkx\" (UniqueName: \"kubernetes.io/projected/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-kube-api-access-tzgkx\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:10.444794 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444733    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4-openshift-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:10.444863 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.444782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8e612b1-6240-4da3-8367-b22f70ebeaff" (UID: "d8e612b1-6240-4da3-8367-b22f70ebeaff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:10.446852 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.446826    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn" (OuterVolumeSpecName: "kube-api-access-k5mfn") pod "d8e612b1-6240-4da3-8367-b22f70ebeaff" (UID: "d8e612b1-6240-4da3-8367-b22f70ebeaff"). InnerVolumeSpecName "kube-api-access-k5mfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:10.545345 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.545239    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e612b1-6240-4da3-8367-b22f70ebeaff-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:10.545345 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.545276    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mfn\" (UniqueName: \"kubernetes.io/projected/d8e612b1-6240-4da3-8367-b22f70ebeaff-kube-api-access-k5mfn\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:10.562534 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.562495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:10.794010 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.793979    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" containerID="e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718" exitCode=0
Jul 29 02:08:10.794206 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.794054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"
Jul 29 02:08:10.794206 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.794064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" event={"ID":"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4","Type":"ContainerDied","Data":"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"}
Jul 29 02:08:10.794206 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.794123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8" event={"ID":"6b350a75-b4c1-4e6e-a2f6-b4b635c736d4","Type":"ContainerDied","Data":"aa4c55b0d033dac5b833db751dbdc5dc1426125a7c30874aa23527e4207ff8dd"}
Jul 29 02:08:10.794206 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.794156    2578 scope.go:117] "RemoveContainer" containerID="e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"
Jul 29 02:08:10.797951 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.796519    2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e612b1-6240-4da3-8367-b22f70ebeaff" containerID="ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7" exitCode=0
Jul 29 02:08:10.797951 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.796729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" event={"ID":"d8e612b1-6240-4da3-8367-b22f70ebeaff","Type":"ContainerDied","Data":"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"}
Jul 29 02:08:10.797951 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.796774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t" event={"ID":"d8e612b1-6240-4da3-8367-b22f70ebeaff","Type":"ContainerDied","Data":"c24f5e3436b7da16603e8ec93843e77572e8552a01b0c415f7cadb3c40e28308"}
Jul 29 02:08:10.797951 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.796855    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"
Jul 29 02:08:10.810761 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.810740    2578 scope.go:117] "RemoveContainer" containerID="e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"
Jul 29 02:08:10.811101 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:08:10.811077    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718\": container with ID starting with e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718 not found: ID does not exist" containerID="e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"
Jul 29 02:08:10.811149 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.811114    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718"} err="failed to get container status \"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718\": rpc error: code = NotFound desc = could not find container \"e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718\": container with ID starting with e3996486cc5c0ee3735d36187a96a317ea31c65cfa52aad1e8a6d7fdeb266718 not found: ID does not exist"
Jul 29 02:08:10.811149 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.811134    2578 scope.go:117] "RemoveContainer" containerID="ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"
Jul 29 02:08:10.821387 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.821185    2578 scope.go:117] "RemoveContainer" containerID="ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"
Jul 29 02:08:10.821609 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:08:10.821552    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7\": container with ID starting with ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7 not found: ID does not exist" containerID="ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"
Jul 29 02:08:10.821695 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.821620    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7"} err="failed to get container status \"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7\": rpc error: code = NotFound desc = could not find container \"ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7\": container with ID starting with ba35bf8781118663b693bcef3680a6fe0544a61ea63117abd07b9085e9d467a7 not found: ID does not exist"
Jul 29 02:08:10.821960 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.821942    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:08:10.824749 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.824724    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5be2ca-859bdc7878-p7jm8"]
Jul 29 02:08:10.833739 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.833709    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:08:10.838417 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:10.838390    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5be2ca-789745c7c6-6lh8t"]
Jul 29 02:08:12.471112 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:12.471079    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" path="/var/lib/kubelet/pods/6b350a75-b4c1-4e6e-a2f6-b4b635c736d4/volumes"
Jul 29 02:08:12.471511 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:12.471430    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8e612b1-6240-4da3-8367-b22f70ebeaff" path="/var/lib/kubelet/pods/d8e612b1-6240-4da3-8367-b22f70ebeaff/volumes"
Jul 29 02:08:16.630512 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:16.630471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:16.733295 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:16.733264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:16.877188 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:16.877152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:17.110712 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:17.110678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:20.542878 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.542841    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"]
Jul 29 02:08:20.543311 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543297    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e612b1-6240-4da3-8367-b22f70ebeaff" containerName="payload-pre-processing"
Jul 29 02:08:20.543311 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543312    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e612b1-6240-4da3-8367-b22f70ebeaff" containerName="payload-pre-processing"
Jul 29 02:08:20.543388 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543343    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" containerName="maas-api"
Jul 29 02:08:20.543388 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543351    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" containerName="maas-api"
Jul 29 02:08:20.543457 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543415    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8e612b1-6240-4da3-8367-b22f70ebeaff" containerName="payload-pre-processing"
Jul 29 02:08:20.543457 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.543424    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b350a75-b4c1-4e6e-a2f6-b4b635c736d4" containerName="maas-api"
Jul 29 02:08:20.548286 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.548259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:20.550620 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.550565    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 02:08:20.553928 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.553827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"]
Jul 29 02:08:20.745052 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.745014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5\" (UID: \"b92c01b5-568b-45b8-9df7-a3bb79b9aa83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:20.845948 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.845840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5\" (UID: \"b92c01b5-568b-45b8-9df7-a3bb79b9aa83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:20.846522 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.846496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5\" (UID: \"b92c01b5-568b-45b8-9df7-a3bb79b9aa83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:20.861680 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:20.861646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:21.050433 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:21.050256    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"]
Jul 29 02:08:21.873967 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:21.873930    2578 generic.go:356] "Generic (PLEG): container finished" podID="b92c01b5-568b-45b8-9df7-a3bb79b9aa83" containerID="53ec637d407ebac4c3c7b55c660b97315dd85c3052181b2edec9d4faff3ae3de" exitCode=0
Jul 29 02:08:21.874383 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:21.874016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5" event={"ID":"b92c01b5-568b-45b8-9df7-a3bb79b9aa83","Type":"ContainerDied","Data":"53ec637d407ebac4c3c7b55c660b97315dd85c3052181b2edec9d4faff3ae3de"}
Jul 29 02:08:21.874383 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:21.874071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5" event={"ID":"b92c01b5-568b-45b8-9df7-a3bb79b9aa83","Type":"ContainerStarted","Data":"a0d5cf5df9de581e47f695ad80330dfb5ad54388e8c1e9783d7616ad0043bd50"}
Jul 29 02:08:23.032302 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.032271    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:23.067190 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.067151    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca\") pod \"b92c01b5-568b-45b8-9df7-a3bb79b9aa83\" (UID: \"b92c01b5-568b-45b8-9df7-a3bb79b9aa83\") "
Jul 29 02:08:23.067523 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.067497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b92c01b5-568b-45b8-9df7-a3bb79b9aa83" (UID: "b92c01b5-568b-45b8-9df7-a3bb79b9aa83"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:23.168262 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.168175    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c01b5-568b-45b8-9df7-a3bb79b9aa83-maas-api-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:23.887183 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.887149    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"
Jul 29 02:08:23.887183 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.887157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5" event={"ID":"b92c01b5-568b-45b8-9df7-a3bb79b9aa83","Type":"ContainerDied","Data":"a0d5cf5df9de581e47f695ad80330dfb5ad54388e8c1e9783d7616ad0043bd50"}
Jul 29 02:08:23.887453 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:23.887203    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0d5cf5df9de581e47f695ad80330dfb5ad54388e8c1e9783d7616ad0043bd50"
Jul 29 02:08:26.840040 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:26.839999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.026172 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.026132    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:08:36.026684 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.026419    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" podUID="1af53a5d-25b4-43ee-bd36-997136aed282" containerName="maas-api" containerID="cri-o://80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0" gracePeriod=30
Jul 29 02:08:36.055422 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.055386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.092565 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.092528    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:08:36.092858 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.092832    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" podUID="b7221ff9-1976-419b-92cc-b3323413e024" containerName="payload-processing" containerID="cri-o://b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1" gracePeriod=30
Jul 29 02:08:36.110226 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.110131    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:08:36.110396 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.110367    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" podUID="d27d28dc-86a1-4600-a752-f8ebd01ad770" containerName="payload-pre-processing" containerID="cri-o://afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a" gracePeriod=30
Jul 29 02:08:36.143637 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.143600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.236330 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.236290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.287194 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.282339    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"]
Jul 29 02:08:36.287194 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.287127    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-74cb2e-d7lr5"]
Jul 29 02:08:36.337364 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.337295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.376759 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.376723    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:08:36.412287 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.412259    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:08:36.439132 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.439096    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:08:36.471684 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.471653    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92c01b5-568b-45b8-9df7-a3bb79b9aa83" path="/var/lib/kubelet/pods/b92c01b5-568b-45b8-9df7-a3bb79b9aa83/volumes"
Jul 29 02:08:36.491525 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smtj\" (UniqueName: \"kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj\") pod \"1af53a5d-25b4-43ee-bd36-997136aed282\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") "
Jul 29 02:08:36.491525 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb886\" (UniqueName: \"kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886\") pod \"d27d28dc-86a1-4600-a752-f8ebd01ad770\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") "
Jul 29 02:08:36.491821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume\") pod \"b7221ff9-1976-419b-92cc-b3323413e024\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") "
Jul 29 02:08:36.491821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b59z6\" (UniqueName: \"kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6\") pod \"b7221ff9-1976-419b-92cc-b3323413e024\" (UID: \"b7221ff9-1976-419b-92cc-b3323413e024\") "
Jul 29 02:08:36.491821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") pod \"1af53a5d-25b4-43ee-bd36-997136aed282\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") "
Jul 29 02:08:36.491821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491728    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca\") pod \"1af53a5d-25b4-43ee-bd36-997136aed282\" (UID: \"1af53a5d-25b4-43ee-bd36-997136aed282\") "
Jul 29 02:08:36.491821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491792    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume\") pod \"d27d28dc-86a1-4600-a752-f8ebd01ad770\" (UID: \"d27d28dc-86a1-4600-a752-f8ebd01ad770\") "
Jul 29 02:08:36.492084 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.491992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7221ff9-1976-419b-92cc-b3323413e024" (UID: "b7221ff9-1976-419b-92cc-b3323413e024"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:36.492368 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.492338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d27d28dc-86a1-4600-a752-f8ebd01ad770" (UID: "d27d28dc-86a1-4600-a752-f8ebd01ad770"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:36.492567 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.492540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1af53a5d-25b4-43ee-bd36-997136aed282" (UID: "1af53a5d-25b4-43ee-bd36-997136aed282"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:36.494528 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.494503    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1af53a5d-25b4-43ee-bd36-997136aed282" (UID: "1af53a5d-25b4-43ee-bd36-997136aed282"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:08:36.494528 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.494524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6" (OuterVolumeSpecName: "kube-api-access-b59z6") pod "b7221ff9-1976-419b-92cc-b3323413e024" (UID: "b7221ff9-1976-419b-92cc-b3323413e024"). InnerVolumeSpecName "kube-api-access-b59z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:36.494687 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.494567    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj" (OuterVolumeSpecName: "kube-api-access-7smtj") pod "1af53a5d-25b4-43ee-bd36-997136aed282" (UID: "1af53a5d-25b4-43ee-bd36-997136aed282"). InnerVolumeSpecName "kube-api-access-7smtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:36.494687 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.494563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886" (OuterVolumeSpecName: "kube-api-access-vb886") pod "d27d28dc-86a1-4600-a752-f8ebd01ad770" (UID: "d27d28dc-86a1-4600-a752-f8ebd01ad770"). InnerVolumeSpecName "kube-api-access-vb886". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593342    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b59z6\" (UniqueName: \"kubernetes.io/projected/b7221ff9-1976-419b-92cc-b3323413e024-kube-api-access-b59z6\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593372    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af53a5d-25b4-43ee-bd36-997136aed282-maas-api-tls\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593382    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af53a5d-25b4-43ee-bd36-997136aed282-openshift-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593390    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d27d28dc-86a1-4600-a752-f8ebd01ad770-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593400    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smtj\" (UniqueName: \"kubernetes.io/projected/1af53a5d-25b4-43ee-bd36-997136aed282-kube-api-access-7smtj\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593408    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb886\" (UniqueName: \"kubernetes.io/projected/d27d28dc-86a1-4600-a752-f8ebd01ad770-kube-api-access-vb886\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.593428 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.593417    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7221ff9-1976-419b-92cc-b3323413e024-plugins-config-volume\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:08:36.658361 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.658329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:36.979607 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.979488    2578 generic.go:356] "Generic (PLEG): container finished" podID="d27d28dc-86a1-4600-a752-f8ebd01ad770" containerID="afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a" exitCode=0
Jul 29 02:08:36.979607 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.979554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"
Jul 29 02:08:36.979865 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.979596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" event={"ID":"d27d28dc-86a1-4600-a752-f8ebd01ad770","Type":"ContainerDied","Data":"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"}
Jul 29 02:08:36.979865 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.979688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv" event={"ID":"d27d28dc-86a1-4600-a752-f8ebd01ad770","Type":"ContainerDied","Data":"df5a5acda307e705bfacf87055c8904a862add82bc6506683b65619aff1ddb3c"}
Jul 29 02:08:36.979865 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.979720    2578 scope.go:117] "RemoveContainer" containerID="afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"
Jul 29 02:08:36.981128 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.981106    2578 generic.go:356] "Generic (PLEG): container finished" podID="1af53a5d-25b4-43ee-bd36-997136aed282" containerID="80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0" exitCode=0
Jul 29 02:08:36.981233 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.981168    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"
Jul 29 02:08:36.981233 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.981183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" event={"ID":"1af53a5d-25b4-43ee-bd36-997136aed282","Type":"ContainerDied","Data":"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"}
Jul 29 02:08:36.981339 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.981315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv" event={"ID":"1af53a5d-25b4-43ee-bd36-997136aed282","Type":"ContainerDied","Data":"56b0f152a455a9fb1df1e7744e82886ff6488ec4882476205118358d65156c0a"}
Jul 29 02:08:36.982903 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.982876    2578 generic.go:356] "Generic (PLEG): container finished" podID="b7221ff9-1976-419b-92cc-b3323413e024" containerID="b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1" exitCode=0
Jul 29 02:08:36.983032 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.982929    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"
Jul 29 02:08:36.983032 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.982944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" event={"ID":"b7221ff9-1976-419b-92cc-b3323413e024","Type":"ContainerDied","Data":"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"}
Jul 29 02:08:36.983032 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.983027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b" event={"ID":"b7221ff9-1976-419b-92cc-b3323413e024","Type":"ContainerDied","Data":"ebe18f696d9c5efd440593973fb246f4456326bd4343ab1dbeea63fe8134e5c5"}
Jul 29 02:08:36.991821 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.991796    2578 scope.go:117] "RemoveContainer" containerID="afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"
Jul 29 02:08:36.992189 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:08:36.992165    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a\": container with ID starting with afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a not found: ID does not exist" containerID="afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"
Jul 29 02:08:36.992294 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.992204    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a"} err="failed to get container status \"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a\": rpc error: code = NotFound desc = could not find container \"afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a\": container with ID starting with afaa4b78d4b87553eca33a11cea2fa2d38ed272f0c279e4d8c9e8606152f225a not found: ID does not exist"
Jul 29 02:08:36.992294 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:36.992231    2578 scope.go:117] "RemoveContainer" containerID="80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"
Jul 29 02:08:37.002557 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.002537    2578 scope.go:117] "RemoveContainer" containerID="80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"
Jul 29 02:08:37.002864 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:08:37.002841    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0\": container with ID starting with 80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0 not found: ID does not exist" containerID="80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"
Jul 29 02:08:37.002959 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.002879    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0"} err="failed to get container status \"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0\": rpc error: code = NotFound desc = could not find container \"80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0\": container with ID starting with 80c58f86c834ee2d8729481d5929e40203f6edcbd962e242e574739a911a8bd0 not found: ID does not exist"
Jul 29 02:08:37.002959 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.002904    2578 scope.go:117] "RemoveContainer" containerID="b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"
Jul 29 02:08:37.013521 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.013486    2578 scope.go:117] "RemoveContainer" containerID="b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"
Jul 29 02:08:37.013867 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:08:37.013846    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1\": container with ID starting with b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1 not found: ID does not exist" containerID="b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"
Jul 29 02:08:37.013947 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.013881    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1"} err="failed to get container status \"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1\": rpc error: code = NotFound desc = could not find container \"b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1\": container with ID starting with b1753ed475e079d5094456fd90e37ebe54fab10fdb2fa83c038d75bac65b1cf1 not found: ID does not exist"
Jul 29 02:08:37.028137 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.028102    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:08:37.034904 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.034873    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-74cb2e-544c7446b8-d4vwv"]
Jul 29 02:08:37.061595 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.061439    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:08:37.064289 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.064267    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-74cb2e-69bb7cc588-trdnv"]
Jul 29 02:08:37.074808 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.074764    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:08:37.077098 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.077079    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-74cb2e-85c76dbb44-6z78b"]
Jul 29 02:08:37.684149 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.684119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:37.737341 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:37.737310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:38.471792 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:38.471758    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af53a5d-25b4-43ee-bd36-997136aed282" path="/var/lib/kubelet/pods/1af53a5d-25b4-43ee-bd36-997136aed282/volumes"
Jul 29 02:08:38.472187 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:38.472117    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7221ff9-1976-419b-92cc-b3323413e024" path="/var/lib/kubelet/pods/b7221ff9-1976-419b-92cc-b3323413e024/volumes"
Jul 29 02:08:38.472436 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:38.472421    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d27d28dc-86a1-4600-a752-f8ebd01ad770" path="/var/lib/kubelet/pods/d27d28dc-86a1-4600-a752-f8ebd01ad770/volumes"
Jul 29 02:08:41.679552 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:08:41.679519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:17.938112 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:17.938076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:19.104630 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:19.104561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:25.127180 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:25.127142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:40.136306 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.136267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:40.221193 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.221152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:40.429372 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.429257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:40.678961 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.678915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:40.796929 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.796878    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"]
Jul 29 02:09:40.797375 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797360    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92c01b5-568b-45b8-9df7-a3bb79b9aa83" containerName="revoke-keys"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797378    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92c01b5-568b-45b8-9df7-a3bb79b9aa83" containerName="revoke-keys"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797394    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d27d28dc-86a1-4600-a752-f8ebd01ad770" containerName="payload-pre-processing"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797401    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d27d28dc-86a1-4600-a752-f8ebd01ad770" containerName="payload-pre-processing"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797414    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af53a5d-25b4-43ee-bd36-997136aed282" containerName="maas-api"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797421    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af53a5d-25b4-43ee-bd36-997136aed282" containerName="maas-api"
Jul 29 02:09:40.797431 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7221ff9-1976-419b-92cc-b3323413e024" containerName="payload-processing"
Jul 29 02:09:40.797773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797436    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7221ff9-1976-419b-92cc-b3323413e024" containerName="payload-processing"
Jul 29 02:09:40.797773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797515    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7221ff9-1976-419b-92cc-b3323413e024" containerName="payload-processing"
Jul 29 02:09:40.797773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797526    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92c01b5-568b-45b8-9df7-a3bb79b9aa83" containerName="revoke-keys"
Jul 29 02:09:40.797773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797545    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d27d28dc-86a1-4600-a752-f8ebd01ad770" containerName="payload-pre-processing"
Jul 29 02:09:40.797773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.797552    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af53a5d-25b4-43ee-bd36-997136aed282" containerName="maas-api"
Jul 29 02:09:40.801042 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.801019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:40.806913 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.806881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 02:09:40.816086 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.816058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"]
Jul 29 02:09:40.910032 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:40.909998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v\" (UID: \"c4665712-556b-431b-affd-70bd0e1e1a48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:41.010858 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:41.010822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v\" (UID: \"c4665712-556b-431b-affd-70bd0e1e1a48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:41.011535 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:41.011512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v\" (UID: \"c4665712-556b-431b-affd-70bd0e1e1a48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:41.112151 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:41.112046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:41.273321 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:41.273295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"]
Jul 29 02:09:41.275261 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:09:41.275230    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4665712_556b_431b_affd_70bd0e1e1a48.slice/crio-755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137 WatchSource:0}: Error finding container 755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137: Status 404 returned error can't find the container with id 755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137
Jul 29 02:09:41.388523 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:41.388437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v" event={"ID":"c4665712-556b-431b-affd-70bd0e1e1a48","Type":"ContainerStarted","Data":"755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137"}
Jul 29 02:09:42.396440 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:42.396350    2578 generic.go:356] "Generic (PLEG): container finished" podID="c4665712-556b-431b-affd-70bd0e1e1a48" containerID="59d2ca2277b521b597f93d652cd6977a04b7a8b349a3ddb34ec9d89373e7bd5b" exitCode=0
Jul 29 02:09:42.396850 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:42.396446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v" event={"ID":"c4665712-556b-431b-affd-70bd0e1e1a48","Type":"ContainerDied","Data":"59d2ca2277b521b597f93d652cd6977a04b7a8b349a3ddb34ec9d89373e7bd5b"}
Jul 29 02:09:43.545237 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:43.545210    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:43.636545 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:43.636514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca\") pod \"c4665712-556b-431b-affd-70bd0e1e1a48\" (UID: \"c4665712-556b-431b-affd-70bd0e1e1a48\") "
Jul 29 02:09:43.636942 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:43.636915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4665712-556b-431b-affd-70bd0e1e1a48" (UID: "c4665712-556b-431b-affd-70bd0e1e1a48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:09:43.737904 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:43.737818    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4665712-556b-431b-affd-70bd0e1e1a48-maas-api-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:09:44.409410 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:44.409369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v" event={"ID":"c4665712-556b-431b-affd-70bd0e1e1a48","Type":"ContainerDied","Data":"755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137"}
Jul 29 02:09:44.409632 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:44.409423    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="755a8c7c065d0ece31317a48b57b77f616c168e724afacf2f8f8b75b376c5137"
Jul 29 02:09:44.409632 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:44.409380    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"
Jul 29 02:09:46.929153 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:46.929116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:09:46.930138 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:46.929370    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" podUID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" containerName="maas-api" containerID="cri-o://44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123" gracePeriod=30
Jul 29 02:09:46.957399 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:46.957368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:47.054057 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.054023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:47.157100 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.157064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:47.198544 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.198515    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:09:47.240957 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.240923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:47.336801 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.336763    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"]
Jul 29 02:09:47.340826 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.340799    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e02970-wkx4v"]
Jul 29 02:09:47.373502 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.373467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gctpk\" (UniqueName: \"kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk\") pod \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") "
Jul 29 02:09:47.373752 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.373523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") pod \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") "
Jul 29 02:09:47.373752 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.373628    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca\") pod \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\" (UID: \"d3d984cd-3a78-47f1-a6cf-1752481ed2ef\") "
Jul 29 02:09:47.374040 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.374013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3d984cd-3a78-47f1-a6cf-1752481ed2ef" (UID: "d3d984cd-3a78-47f1-a6cf-1752481ed2ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:09:47.375842 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.375804    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3d984cd-3a78-47f1-a6cf-1752481ed2ef" (UID: "d3d984cd-3a78-47f1-a6cf-1752481ed2ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:09:47.375951 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.375899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk" (OuterVolumeSpecName: "kube-api-access-gctpk") pod "d3d984cd-3a78-47f1-a6cf-1752481ed2ef" (UID: "d3d984cd-3a78-47f1-a6cf-1752481ed2ef"). InnerVolumeSpecName "kube-api-access-gctpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:09:47.428816 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.428780    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" containerID="44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123" exitCode=0
Jul 29 02:09:47.429005 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.428832    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"
Jul 29 02:09:47.429005 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.428848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" event={"ID":"d3d984cd-3a78-47f1-a6cf-1752481ed2ef","Type":"ContainerDied","Data":"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"}
Jul 29 02:09:47.429005 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.428901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6" event={"ID":"d3d984cd-3a78-47f1-a6cf-1752481ed2ef","Type":"ContainerDied","Data":"25136aaef2f4d15b169febedcd37ed99e6e695e241a8405074728a0ca7f2bc97"}
Jul 29 02:09:47.429005 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.428931    2578 scope.go:117] "RemoveContainer" containerID="44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"
Jul 29 02:09:47.439688 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.439664    2578 scope.go:117] "RemoveContainer" containerID="44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"
Jul 29 02:09:47.440166 ip-10-0-133-32 kubenswrapper[2578]: E0729 02:09:47.440143    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123\": container with ID starting with 44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123 not found: ID does not exist" containerID="44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"
Jul 29 02:09:47.440272 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.440175    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123"} err="failed to get container status \"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123\": rpc error: code = NotFound desc = could not find container \"44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123\": container with ID starting with 44017668a04708721446a2c9ba41954966f8d5813e09021184e14dff34bd7123 not found: ID does not exist"
Jul 29 02:09:47.458804 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.458772    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:09:47.464903 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.464868    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e02970-558bdd5f55-bdgx6"]
Jul 29 02:09:47.475792 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.475751    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gctpk\" (UniqueName: \"kubernetes.io/projected/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-kube-api-access-gctpk\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:09:47.475792 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.475789    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-maas-api-tls\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:09:47.475987 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.475806    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d984cd-3a78-47f1-a6cf-1752481ed2ef-openshift-service-ca\") on node \"ip-10-0-133-32.ec2.internal\" DevicePath \"\""
Jul 29 02:09:47.800517 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:47.800483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:48.471252 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:48.471210    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4665712-556b-431b-affd-70bd0e1e1a48" path="/var/lib/kubelet/pods/c4665712-556b-431b-affd-70bd0e1e1a48/volumes"
Jul 29 02:09:48.471773 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:48.471756    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" path="/var/lib/kubelet/pods/d3d984cd-3a78-47f1-a6cf-1752481ed2ef/volumes"
Jul 29 02:09:53.809256 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:53.809205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:53.911271 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:53.911222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:54.154084 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:54.153967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:09:54.323476 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:09:54.323440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:05.079555 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:05.079458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:05.181643 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:05.181602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:05.281688 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:05.281653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:05.351985 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:05.351876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:05.645171 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:05.645081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:11.955957 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:11.955917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:12.056846 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:12.056810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:12.220228 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:12.220136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:12.446445 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:12.446412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:18.106840 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:18.106799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:18.200557 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:18.200468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:18.300005 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:18.299967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:18.368383 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:18.368350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:18.699164 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:18.699128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:25.282696 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:25.282657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:27.211735 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:27.211696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:31.705839 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:31.705808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m98g7_84b602ad-ee5c-428e-b1bb-56f0ebefcd61/manager/0.log"
Jul 29 02:10:31.829897 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:31.829868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qg9dv_f9b2adb7-ba90-4b16-8887-c60a879f990e/manager/0.log"
Jul 29 02:10:32.218268 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:32.218235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l9l66_24f19956-dfc3-4168-b36b-47dbd1091bd6/manager/0.log"
Jul 29 02:10:32.451770 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:32.451742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-hlzrp_1205a035-b734-4b7d-ba71-eb8054788a73/copy-manifests/0.log"
Jul 29 02:10:32.471408 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:32.471311    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-hlzrp_1205a035-b734-4b7d-ba71-eb8054788a73/manager/0.log"
Jul 29 02:10:32.965147 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:32.965111    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-58648fb4fc-kc7qj_88823cc9-2426-41a1-b9e0-af40d925a7f8/maas-api/0.log"
Jul 29 02:10:33.078062 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:33.078030    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754810-5x62t_5afb6498-fcf0-490e-ab64-e1d75225a0b8/cleanup/0.log"
Jul 29 02:10:33.465029 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:33.464979    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xq8kn_a4d603cd-3606-4c95-910a-54fdf26183ae/postgres/0.log"
Jul 29 02:10:34.261845 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.261815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/util/0.log"
Jul 29 02:10:34.268667 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.268628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/pull/0.log"
Jul 29 02:10:34.275221 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.275197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/extract/0.log"
Jul 29 02:10:34.388759 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.388730    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/util/0.log"
Jul 29 02:10:34.395604 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.395562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/pull/0.log"
Jul 29 02:10:34.404455 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.404428    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/extract/0.log"
Jul 29 02:10:34.518913 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.518833    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/pull/0.log"
Jul 29 02:10:34.526594 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.526558    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/extract/0.log"
Jul 29 02:10:34.533446 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.533423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/util/0.log"
Jul 29 02:10:34.644811 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.644783    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/util/0.log"
Jul 29 02:10:34.652359 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.652320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/pull/0.log"
Jul 29 02:10:34.660068 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.660047    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/extract/0.log"
Jul 29 02:10:34.935209 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:34.935124    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v2wtn_ade71b84-00e8-4ce2-b4ff-89a969572bc4/manager/0.log"
Jul 29 02:10:35.049423 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:35.049388    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9nkkn_ac1766ac-9f31-47e7-ba8e-14ea559adfc5/manager/0.log"
Jul 29 02:10:35.160357 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:35.160328    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h2fms_2951fb51-029c-4d3f-8550-2892b25a6898/kuadrant-console-plugin/0.log"
Jul 29 02:10:35.288490 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:35.288444    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r6xtb_e4907d7c-cec7-44e1-b4cf-62d2d5fcb682/registry-server/0.log"
Jul 29 02:10:35.413568 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:35.413521    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8wkp_9dceae4a-77a1-4298-8c07-e956d0f34262/manager/0.log"
Jul 29 02:10:35.646516 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:35.646425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7zv8h_d875e18a-b5d4-413a-bf85-6ef9ed14394d/manager/0.log"
Jul 29 02:10:36.251056 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:36.251028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86657cdbcd-cphn7_1c925f37-8ee6-475a-9f02-24a97d1500a3/kube-auth-proxy/0.log"
Jul 29 02:10:36.606543 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:36.606453    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mdzbh_cb724761-4ed7-4d3b-bc9a-894270948223/payload-pre-processing/0.log"
Jul 29 02:10:36.732385 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:36.732348    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:10:36.844132 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:36.844086    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88848ff99-95vmc_4d6270cf-5a84-4767-8299-da274feb9c8a/router/0.log"
Jul 29 02:10:37.187432 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:37.187398    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xt9pk_64f4baf9-1338-416f-8b82-392d97e696eb/main/0.log"
Jul 29 02:10:37.412767 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:37.412741    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-prqgm_a1d6ab86-960a-4802-a4db-0f1c1e3af31e/main/0.log"
Jul 29 02:10:37.642192 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:37.642162    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4rp5q_297c32f2-850b-444c-aa50-e96e60f4e0e5/main/0.log"
Jul 29 02:10:43.063131 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:43.063085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:43.161594 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:43.161538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:46.121825 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:46.121789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lg88h_6aef0f5e-99c0-49bb-93ca-911a9ff3b3cc/global-pull-secret-syncer/0.log"
Jul 29 02:10:46.238637 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:46.238599    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log"
Jul 29 02:10:46.359238 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:46.359205    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-32.ec2.internal_d59f0475dd3691eab2a3820645b1db6b/haproxy/0.log"
Jul 29 02:10:46.710098 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:46.710048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:46.810004 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:46.809960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b4nz7_52093707-d707-4572-8329-a568e2708dad/konnectivity-agent/0.log" limit=1024
Jul 29 02:10:50.467511 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.467412    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/extract/0.log"
Jul 29 02:10:50.494142 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.494109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/util/0.log"
Jul 29 02:10:50.525619 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.525559    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ncp2q_b05e307c-b575-48e1-9570-14554d5a0b6e/pull/0.log"
Jul 29 02:10:50.563479 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.563443    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/extract/0.log"
Jul 29 02:10:50.605488 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.605453    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/util/0.log"
Jul 29 02:10:50.629148 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.629122    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zzbtt_7042da3f-cd46-4647-bd40-7ef522099056/pull/0.log"
Jul 29 02:10:50.664167 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.664142    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/extract/0.log"
Jul 29 02:10:50.694714 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.694678    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/util/0.log"
Jul 29 02:10:50.720917 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.720833    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c9wv7_130b87d0-4259-4e0c-a4aa-3f89855a9993/pull/0.log"
Jul 29 02:10:50.756395 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.756366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/extract/0.log"
Jul 29 02:10:50.787068 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.787037    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/util/0.log"
Jul 29 02:10:50.821493 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:50.821461    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqdlz_1ba7f9cd-54ec-4928-a9d2-a41c4c9760c1/pull/0.log"
Jul 29 02:10:51.340186 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.340149    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v2wtn_ade71b84-00e8-4ce2-b4ff-89a969572bc4/manager/0.log"
Jul 29 02:10:51.366054 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.366028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9nkkn_ac1766ac-9f31-47e7-ba8e-14ea559adfc5/manager/0.log"
Jul 29 02:10:51.396044 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.396017    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h2fms_2951fb51-029c-4d3f-8550-2892b25a6898/kuadrant-console-plugin/0.log"
Jul 29 02:10:51.457445 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.457406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r6xtb_e4907d7c-cec7-44e1-b4cf-62d2d5fcb682/registry-server/0.log"
Jul 29 02:10:51.718176 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.718095    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8wkp_9dceae4a-77a1-4298-8c07-e956d0f34262/manager/0.log"
Jul 29 02:10:51.861998 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:51.861965    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7zv8h_d875e18a-b5d4-413a-bf85-6ef9ed14394d/manager/0.log"
Jul 29 02:10:54.159959 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.159931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f84d6698-fg5tr_7dd1caf1-45d6-4ac2-ba40-a38569c472e6/metrics-server/0.log"
Jul 29 02:10:54.232925 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.232896    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5mql7_4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9/node-exporter/0.log"
Jul 29 02:10:54.256390 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.256363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5mql7_4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9/kube-rbac-proxy/0.log"
Jul 29 02:10:54.282047 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.282021    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5mql7_4f3551ef-ef6f-45be-9f0f-f3245b5d1ed9/init-textfile/0.log"
Jul 29 02:10:54.810443 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.810413    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-ljzld_648ce93c-820a-4a75-9243-e43b90437759/prometheus-operator/0.log"
Jul 29 02:10:54.831969 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:54.831940    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-ljzld_648ce93c-820a-4a75-9243-e43b90437759/kube-rbac-proxy/0.log"
Jul 29 02:10:55.506333 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506301    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"]
Jul 29 02:10:55.506733 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506714    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4665712-556b-431b-affd-70bd0e1e1a48" containerName="revoke-keys"
Jul 29 02:10:55.506776 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506736    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4665712-556b-431b-affd-70bd0e1e1a48" containerName="revoke-keys"
Jul 29 02:10:55.506776 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506749    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" containerName="maas-api"
Jul 29 02:10:55.506776 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506755    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" containerName="maas-api"
Jul 29 02:10:55.506873 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d984cd-3a78-47f1-a6cf-1752481ed2ef" containerName="maas-api"
Jul 29 02:10:55.506873 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.506836    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4665712-556b-431b-affd-70bd0e1e1a48" containerName="revoke-keys"
Jul 29 02:10:55.514053 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.512210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.516059 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.516029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hd2h\"/\"kube-root-ca.crt\""
Jul 29 02:10:55.516205 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.516054    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hd2h\"/\"openshift-service-ca.crt\""
Jul 29 02:10:55.516876 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.516823    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hd2h\"/\"default-dockercfg-8smzm\""
Jul 29 02:10:55.524973 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.524947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"]
Jul 29 02:10:55.600016 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.599972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-podres\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.600211 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.600027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqzx\" (UniqueName: \"kubernetes.io/projected/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-kube-api-access-2sqzx\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.600211 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.600064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-proc\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.600211 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.600101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-sys\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.600211 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.600186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-lib-modules\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701373 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-podres\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701373 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqzx\" (UniqueName: \"kubernetes.io/projected/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-kube-api-access-2sqzx\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-proc\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-sys\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-proc\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-podres\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-sys\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-lib-modules\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.701654 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.701652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-lib-modules\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.710540 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.710506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqzx\" (UniqueName: \"kubernetes.io/projected/b7129e04-eb5a-41f3-a1f2-de6befb2a3eb-kube-api-access-2sqzx\") pod \"perf-node-gather-daemonset-5l5pc\" (UID: \"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.825106 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.825030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:55.984405 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:55.984377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"]
Jul 29 02:10:55.986243 ip-10-0-133-32 kubenswrapper[2578]: W0729 02:10:55.986209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7129e04_eb5a_41f3_a1f2_de6befb2a3eb.slice/crio-2678e8eee29d550918a8df00bd1625c9b2d652de901a1bfb61e61c613b685b5a WatchSource:0}: Error finding container 2678e8eee29d550918a8df00bd1625c9b2d652de901a1bfb61e61c613b685b5a: Status 404 returned error can't find the container with id 2678e8eee29d550918a8df00bd1625c9b2d652de901a1bfb61e61c613b685b5a
Jul 29 02:10:56.386452 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:56.386356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-mhcfh_f94b01dd-72c4-4d2b-83b2-b69e35c4162a/networking-console-plugin/0.log"
Jul 29 02:10:56.849011 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:56.848976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc" event={"ID":"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb","Type":"ContainerStarted","Data":"cf0b9aca15e141c0f60ee15a1d4927ef3f3732b75f3cded3384b7063f56be385"}
Jul 29 02:10:56.849437 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:56.849029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc" event={"ID":"b7129e04-eb5a-41f3-a1f2-de6befb2a3eb","Type":"ContainerStarted","Data":"2678e8eee29d550918a8df00bd1625c9b2d652de901a1bfb61e61c613b685b5a"}
Jul 29 02:10:56.849437 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:56.849060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:10:56.871774 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:56.871719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc" podStartSLOduration=1.871703278 podStartE2EDuration="1.871703278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:10:56.868469194 +0000 UTC m=+3646.897710103" watchObservedRunningTime="2026-07-29 02:10:56.871703278 +0000 UTC m=+3646.900944191"
Jul 29 02:10:57.493126 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:57.493100    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55c6cbb86c-2b4wd_50c065b9-8d95-4237-ac79-a26dcfcd76c9/console/0.log"
Jul 29 02:10:58.157178 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:58.157145    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-7lv5w_094e4f68-d28a-4711-b9b4-9d43bd9291db/volume-data-source-validator/0.log"
Jul 29 02:10:59.225113 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:59.225079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5j2zt_a6cb163e-59ae-40c0-ab81-952320ea89b9/dns/0.log"
Jul 29 02:10:59.250065 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:59.250035    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5j2zt_a6cb163e-59ae-40c0-ab81-952320ea89b9/kube-rbac-proxy/0.log"
Jul 29 02:10:59.417363 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:10:59.417333    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nrv2q_26e9e02f-12de-4e5b-a6fc-ede1e0fd2022/dns-node-resolver/0.log"
Jul 29 02:11:00.046109 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:00.046077    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5tgf_deaa41ae-5ccc-4706-8f61-4c6f2f97cd92/node-ca/0.log"
Jul 29 02:11:01.353974 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:01.353945    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86657cdbcd-cphn7_1c925f37-8ee6-475a-9f02-24a97d1500a3/kube-auth-proxy/0.log"
Jul 29 02:11:01.519391 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:01.519356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mdzbh_cb724761-4ed7-4d3b-bc9a-894270948223/payload-pre-processing/0.log"
Jul 29 02:11:01.559451 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:01.559416    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:11:01.584391 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:01.584364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88848ff99-95vmc_4d6270cf-5a84-4767-8299-da274feb9c8a/router/0.log"
Jul 29 02:11:02.422547 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:02.422513    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9ptcc_2bc4543b-3ba8-4273-95e8-a258faa03958/serve-healthcheck-canary/0.log"
Jul 29 02:11:02.866375 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:02.866349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-5l5pc"
Jul 29 02:11:03.043149 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:03.043106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8v9jv_1e5cc00a-5347-4c46-9017-8f0c1fb5e593/insights-operator/0.log"
Jul 29 02:11:03.045008 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:03.044983    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8v9jv_1e5cc00a-5347-4c46-9017-8f0c1fb5e593/insights-operator/1.log"
Jul 29 02:11:03.238282 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:03.238194    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dl7c2_c5ca0e97-8159-4564-af2a-133d8cc0ab88/kube-rbac-proxy/0.log"
Jul 29 02:11:03.261881 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:03.261860    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dl7c2_c5ca0e97-8159-4564-af2a-133d8cc0ab88/exporter/0.log"
Jul 29 02:11:03.287278 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:03.287256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dl7c2_c5ca0e97-8159-4564-af2a-133d8cc0ab88/extractor/0.log"
Jul 29 02:11:05.819438 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:05.819403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m98g7_84b602ad-ee5c-428e-b1bb-56f0ebefcd61/manager/0.log"
Jul 29 02:11:06.218410 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.218374    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qg9dv_f9b2adb7-ba90-4b16-8887-c60a879f990e/manager/0.log"
Jul 29 02:11:06.617369 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.617336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86657cdbcd-cphn7_1c925f37-8ee6-475a-9f02-24a97d1500a3/kube-auth-proxy/0.log"
Jul 29 02:11:06.748372 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.748340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l9l66_24f19956-dfc3-4168-b36b-47dbd1091bd6/manager/0.log"
Jul 29 02:11:06.750338 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.750314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mdzbh_cb724761-4ed7-4d3b-bc9a-894270948223/payload-pre-processing/0.log"
Jul 29 02:11:06.790372 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.790343    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:11:06.806171 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.806141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88848ff99-95vmc_4d6270cf-5a84-4767-8299-da274feb9c8a/router/0.log"
Jul 29 02:11:06.984129 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:06.984104    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-hlzrp_1205a035-b734-4b7d-ba71-eb8054788a73/manager/0.log"
Jul 29 02:11:07.007862 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:07.007830    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-hlzrp_1205a035-b734-4b7d-ba71-eb8054788a73/copy-manifests/0.log"
Jul 29 02:11:08.433697 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:08.433662    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86657cdbcd-cphn7_1c925f37-8ee6-475a-9f02-24a97d1500a3/kube-auth-proxy/0.log"
Jul 29 02:11:08.558300 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:08.558268    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-mdzbh_cb724761-4ed7-4d3b-bc9a-894270948223/payload-pre-processing/0.log"
Jul 29 02:11:08.594571 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:08.594537    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-d47hn_13933f55-0bfd-4f7f-8147-edd459cb360d/payload-processing/0.log"
Jul 29 02:11:08.615378 ip-10-0-133-32 kubenswrapper[2578]: I0729 02:11:08.615345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88848ff99-95vmc_4d6270cf-5a84-4767-8299-da274feb9c8a/router/0.log"