Jul 21 04:04:11.137505 ip-10-0-135-112 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 04:04:11.547050 ip-10-0-135-112 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:11.547050 ip-10-0-135-112 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 04:04:11.547050 ip-10-0-135-112 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:11.547050 ip-10-0-135-112 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 04:04:11.547050 ip-10-0-135-112 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:11.547991 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.547909    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554660    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554679    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554683    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554686    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554690    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554693    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554697    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.554689 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554700    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554703    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554706    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554709    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554711    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554715    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554717    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554720    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554723    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554725    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554728    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554730    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554733    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554737    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554740    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554742    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554745    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554747    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554750    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.554977 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554752    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554755    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554757    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554759    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554762    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554764    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554767    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554770    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554772    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554775    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554777    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554780    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554782    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554785    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554787    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554790    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554793    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554795    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554800    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554805    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.555495 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554808    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554811    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554814    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554818    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554820    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554823    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554826    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554829    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554832    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554835    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554837    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554840    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554842    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554844    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554847    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554849    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554852    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554854    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554857    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554859    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.555975 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554862    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554864    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554867    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554870    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554872    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554875    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554878    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554881    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554884    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554887    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554889    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554892    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554894    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554897    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554899    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554901    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554905    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554909    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554913    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.556478 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554916    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554919    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554923    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554926    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554929    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554931    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554934    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554936    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554939    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554942    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554944    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554947    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554949    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.554952    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555719    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555726    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555729    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555732    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555736    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.556933 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555739    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555743    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555745    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555748    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555751    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555754    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555756    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555759    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555761    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555764    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555766    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555769    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555772    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555774    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555777    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555779    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555782    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555784    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555787    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555789    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.557410 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555792    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555794    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555797    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555799    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555802    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555805    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555807    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555810    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555813    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555815    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555818    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555820    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555822    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555825    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555827    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555830    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555832    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555836    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555840    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555843    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.557902 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555846    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555848    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555851    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555853    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555855    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555859    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555862    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555864    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555866    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555869    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555872    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555874    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555877    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555881    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555885    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555887    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555890    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555893    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555896    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.558401 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555899    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555902    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555904    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555907    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555910    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555912    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555914    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555917    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555919    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555922    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555924    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555927    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555929    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555931    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555934    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555936    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555939    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555942    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555945    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555948    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.558876 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555951    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555953    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555956    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555960    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555963    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555966    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555968    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555971    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555973    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555976    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555979    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555981    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555984    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555987    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.555989    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556396    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556409    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556412    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556415    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.559386 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556417    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556420    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556423    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556426    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556428    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556431    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556433    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556436    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556438    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556443    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556446    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556450    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556454    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556457    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556460    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556463    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556466    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556469    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556472    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.559849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556475    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556478    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556482    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556485    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556491    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556494    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556496    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556499    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556501    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556504    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556506    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556509    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556511    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556514    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556516    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556519    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556521    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556526    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556528    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.560312 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556531    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556533    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556535    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556538    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556540    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556543    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556548    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556550    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556553    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556555    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556558    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556560    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556563    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556566    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556568    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556571    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556575    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556577    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556580    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556582    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.560913 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556585    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556587    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556589    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556592    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556594    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556597    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556599    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556602    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556604    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556606    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556609    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556611    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556613    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556616    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556618    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556620    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556623    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556625    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556628    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556631    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.561432 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556633    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556637    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556641    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556643    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556646    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556648    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556651    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556654    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556657    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556660    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556662    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556664    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556667    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556670    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556672    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.556674    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556748    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556755    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556762    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556767    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 04:04:11.561921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556771    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556774    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556778    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556782    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556785    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556788    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556792    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556795    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556798    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556801    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556803    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556806    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556813    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556816    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556820    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556823    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556826    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556829    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556832    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556836    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556840    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556843    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556846    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556850    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 04:04:11.562443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556852    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556855    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556859    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556861    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556865    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556868    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556871    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556873    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556876    2578 flags.go:64] FLAG: --enable-server="true"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556879    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556884    2578 flags.go:64] FLAG: --event-burst="100"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556887    2578 flags.go:64] FLAG: --event-qps="50"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556889    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556893    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556895    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556899    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556902    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556905    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556908    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556915    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556918    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556922    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556925    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556928    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556931    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 04:04:11.563020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556934    2578 flags.go:64] FLAG: --feature-gates=""
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556938    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556941    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556945    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556949    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556951    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556954    2578 flags.go:64] FLAG: --help="false"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556957    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556960    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556963    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556967    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556970    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556973    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556976    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556979    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556982    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556985    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556988    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556991    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556994    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556996    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.556999    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557002    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557005    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 04:04:11.563666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557007    2578 flags.go:64] FLAG: --lock-file=""
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557010    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557014    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557017    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557022    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557026    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557029    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557031    2578 flags.go:64] FLAG: --logging-format="text"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557034    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557037    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557040    2578 flags.go:64] FLAG: --manifest-url=""
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557044    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557048    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557051    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557054    2578 flags.go:64] FLAG: --max-pods="110"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557057    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557060    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557063    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557066    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557069    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557072    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557075    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557082    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557085    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557088    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 04:04:11.564260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557091    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557094    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557100    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557103    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557106    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557109    2578 flags.go:64] FLAG: --port="10250"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557111    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557115    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0625df9fede383e0d"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557118    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557122    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557125    2578 flags.go:64] FLAG: --register-node="true"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557128    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557132    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557135    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557138    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557141    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557144    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557147    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557150    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557154    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557157    2578 flags.go:64] FLAG: --runonce="false"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557159    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557162    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557165    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557168    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 04:04:11.564870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557171    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557174    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557177    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557180    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557183    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557186    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557188    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557191    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557194    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557197    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557199    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557204    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557207    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557224    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557228    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557231    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557235    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557238    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557241    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557243    2578 flags.go:64] FLAG: --v="2"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557247    2578 flags.go:64] FLAG: --version="false"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557252    2578 flags.go:64] FLAG: --vmodule=""
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557256    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557259    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557373    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.565496 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557377    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557382    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557385    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557388    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557391    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557394    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557396    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557399    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557401    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557404    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557406    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557409    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557412    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557414    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557417    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557420    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557423    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557425    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557428    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557431    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.566125 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557433    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557436    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557438    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557442    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557445    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557447    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557449    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557452    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557454    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557458    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557460    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557464    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557468    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557472    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557474    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557477    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557480    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557483    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557485    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557487    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.566648 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557490    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557492    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557495    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557498    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557501    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557504    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557508    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557510    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557513    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557516    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557519    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557521    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557526    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557529    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557532    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557535    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557538    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557540    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.567118 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557543    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557545    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557548    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557551    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557553    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557555    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557559    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557561    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557564    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557566    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557569    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557572    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557574    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557576    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557579    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557581    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557584    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557586    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557590    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.567599 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557593    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557596    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557599    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557601    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557604    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557606    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557609    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557611    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557614    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557617    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557620    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557622    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557625    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557628    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557630    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557632    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557635    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557638    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557640    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.568049 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.557644    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.557649    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.564698    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.564713    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.564732    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.564740    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564810    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564816    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564821    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564824    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564827    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564830    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564833    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564835    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.568548 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564838    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564841    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564844    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564847    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564849    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564852    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564855    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564857    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564860    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564862    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564864    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564870    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564873    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564876    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564879    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564888    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564891    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564894    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564896    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.568892 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564899    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564902    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564905    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564908    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564910    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564913    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564915    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564917    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564920    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564923    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564925    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564927    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564930    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564933    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564935    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564937    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564940    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564942    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564945    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564947    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.569453 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564949    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564952    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564954    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564957    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564959    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564962    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564964    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564966    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564969    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564972    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564975    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564978    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564981    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564984    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564986    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564989    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564991    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564993    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564996    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.564998    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.569937 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565001    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565003    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565005    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565008    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565010    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565013    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565015    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565018    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565020    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565023    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565025    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565028    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565030    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565033    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565035    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565040    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565043    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565045    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565048    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.570435 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565050    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565053    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565056    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565060    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565064    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565067    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565070    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565073    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565075    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565078    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565080    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.565085    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565193    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565197    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565200    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:11.570899 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565203    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565206    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565228    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565232    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565235    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565238    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565241    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565244    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565247    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565250    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565253    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565256    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565258    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565261    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565264    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565266    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565269    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565272    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565275    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565277    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:11.571272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565280    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565283    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565286    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565288    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565290    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565293    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565296    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565298    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565300    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565303    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565305    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565309    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565313    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565316    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565319    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565322    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565325    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565331    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565333    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:11.571746 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565336    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565338    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565340    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565344    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565346    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565348    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565351    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565353    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565355    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565358    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565360    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565363    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565365    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565367    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565371    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565373    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565375    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565378    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565380    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565383    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:11.572220 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565385    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565387    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565390    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565392    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565395    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565397    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565399    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565402    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565404    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565407    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565409    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565412    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565416    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565419    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565421    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565425    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565427    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565430    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565433    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:11.572715 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565435    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565438    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565440    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565443    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565445    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565448    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565450    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565453    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565456    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565458    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565461    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565463    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565466    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565468    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565470    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565473    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565475    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:11.573182 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:11.565478    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.565482    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.565575    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.567831    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.569335    2578 server.go:1019] "Starting client certificate rotation"
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.569436    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.569478    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:11.573795 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.572199    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:11.576252 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.576238    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:11.588875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.588851    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 21 04:04:11.591890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.591870    2578 log.go:25] "Validated CRI v1 image API"
Jul 21 04:04:11.593090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.593075    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 04:04:11.596050 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.596024    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 951a7875-78ea-4023-8abd-14f53137cf10:/dev/nvme0n1p3 a1c796d7-1927-46f0-bd1c-ad9ef3d1bf44:/dev/nvme0n1p4]
Jul 21 04:04:11.596118 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.596045    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 04:04:11.600049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.600023    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:11.601206 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.601096    2578 manager.go:216] Machine: {Timestamp:2026-07-21 04:04:11.599743002 +0000 UTC m=+0.349793490 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103673 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a433244bd5089b2d8e535468fe6c SystemUUID:ec24a433-244b-d508-9b2d-8e535468fe6c BootID:4c52d3a5-9339-4489-aa59-3cc136188d5d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:48:61:1b:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:48:61:1b:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:76:50:cc:86:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 04:04:11.601206 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.601204    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 04:04:11.601333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.601301    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 04:04:11.604225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.604188    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 04:04:11.604371 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.604225    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 04:04:11.604899 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.604890    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 04:04:11.604929 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.604903    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 04:04:11.604929 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.604911    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:11.605588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.605577    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:11.607133 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.607123    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 04:04:11.609947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.609935    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:11.610095 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610085    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 04:04:11.610138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610129    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 04:04:11.610189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610142    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 04:04:11.610189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610159    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 04:04:11.610189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610169    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 21 04:04:11.610189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610178    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 04:04:11.610579 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610566    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:11.610636 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.610585    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:11.612560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.612542    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 04:04:11.613905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.613888    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 04:04:11.613995 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.613928    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 04:04:11.614624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614610    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614630    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614639    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614648    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614659    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614667    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614679    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614686    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614697    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614705    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614717    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 04:04:11.614721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614726    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 04:04:11.615156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614757    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 04:04:11.615156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.614768    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 04:04:11.618095 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.618079    2578 server.go:1268] "Started kubelet"
Jul 21 04:04:11.618333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.618298    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 04:04:11.618391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.618355    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 04:04:11.623431 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.623303    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-br7nq"
Jul 21 04:04:11.623431 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.618359    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 04:04:11.623548 ip-10-0-135-112 systemd[1]: Started Kubernetes Kubelet.
Jul 21 04:04:11.624385 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.624295    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 04:04:11.624385 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.624356    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 04:04:11.624680 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.624660    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 04:04:11.624738 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.624708    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 04:04:11.625799 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.625772    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 04:04:11.626986 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.626969    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 04:04:11.628242 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.627390    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-112.ec2.internal.18c4324b5d7e4a1a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-112.ec2.internal,UID:ip-10-0-135-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-112.ec2.internal,},FirstTimestamp:2026-07-21 04:04:11.618052634 +0000 UTC m=+0.368103122,LastTimestamp:2026-07-21 04:04:11.618052634 +0000 UTC m=+0.368103122,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-112.ec2.internal,}"
Jul 21 04:04:11.629063 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.629048    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-br7nq"
Jul 21 04:04:11.632674 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.632655    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 04:04:11.632674 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.632666    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:11.632838 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.632820    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:11.633471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633450    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 04:04:11.633567 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633488    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 04:04:11.633669 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633649    2578 factory.go:55] Registering systemd factory
Jul 21 04:04:11.633723 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633672    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 21 04:04:11.633723 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633717    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 04:04:11.634151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633852    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 04:04:11.634151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.633862    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 04:04:11.634289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634182    2578 factory.go:153] Registering CRI-O factory
Jul 21 04:04:11.634289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634193    2578 factory.go:223] Registration of the crio container factory successfully
Jul 21 04:04:11.634289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634262    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 04:04:11.634404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634290    2578 factory.go:103] Registering Raw factory
Jul 21 04:04:11.634404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634306    2578 manager.go:1196] Started watching for new ooms in manager
Jul 21 04:04:11.635001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.634986    2578 manager.go:349] Starting recovery of all containers
Jul 21 04:04:11.645320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.645300    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:11.645994 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.645978    2578 manager.go:354] Recovery completed
Jul 21 04:04:11.648258 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.648121    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-112.ec2.internal\" not found" node="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.650845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.650833    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.652620 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.652603    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.652679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.652633    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.652679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.652644    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.653152 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653139    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 04:04:11.653202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653150    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 04:04:11.653202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653166    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.653301 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653169    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:11.653957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653943    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.654023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653973    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.654023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.653983    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.654543 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.654531    2578 policy_none.go:49] "None policy: Start"
Jul 21 04:04:11.654580 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.654548    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 04:04:11.654580 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.654558    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 04:04:11.655416 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.655405    2578 policy_none.go:47] "Start"
Jul 21 04:04:11.693864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.693850    2578 manager.go:337] "Starting Device Plugin manager"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.693901    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.693911    2578 server.go:87] "Starting device plugin registration server"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.694184    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.694194    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.694333    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.694413    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.694421    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.694939    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 04:04:11.701961 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.694987    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:11.772995 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.772961    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 04:04:11.774280 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.774260    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 04:04:11.774342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.774310    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 04:04:11.774342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.774337    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 04:04:11.774407 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.774377    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 04:04:11.777035 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.777008    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:11.795293 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.795269    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.796042 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.796024    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.796146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.796056    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.796146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.796068    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.796146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.796098    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.806170 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.806126    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.806170 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.806149    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-112.ec2.internal\": node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:11.834418 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.834392    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:11.874654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.874627    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"]
Jul 21 04:04:11.874735 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.874703    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.876568 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.876553    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.876633 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.876583    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.876633 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.876593    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.877728 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.877716    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.877888 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.877875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.877933 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.877903    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.878442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878427    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.878482 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878460    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.878482 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878470    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.878549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878429    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.878549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878529    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.878549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.878541    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.879685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.879664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.879781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.879697    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:11.880392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.880372    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:11.880501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.880409    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:11.880501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.880426    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:11.901957 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.901934    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-112.ec2.internal\" not found" node="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.906325 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.906311    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-112.ec2.internal\" not found" node="ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.934570 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:11.934547    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:11.935712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.935696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1399c85245541448fb6c7788aff95862-config\") pod \"kube-apiserver-proxy-ip-10-0-135-112.ec2.internal\" (UID: \"1399c85245541448fb6c7788aff95862\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.935768 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.935723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:11.935768 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:11.935741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.034782 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.034753    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.035941 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.035920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1399c85245541448fb6c7788aff95862-config\") pod \"kube-apiserver-proxy-ip-10-0-135-112.ec2.internal\" (UID: \"1399c85245541448fb6c7788aff95862\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.035941 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.035934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1399c85245541448fb6c7788aff95862-config\") pod \"kube-apiserver-proxy-ip-10-0-135-112.ec2.internal\" (UID: \"1399c85245541448fb6c7788aff95862\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.036074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.035961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.036074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.035986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.036074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.036036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.036074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.036064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79f8e6bbb86a37842b41f2e25ac18265-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal\" (UID: \"79f8e6bbb86a37842b41f2e25ac18265\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.134900 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.134836    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.204223 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.204176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.210008 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.209992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.235766 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.235740    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.336380 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.336346    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.436983 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.436898    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.537478 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.537447    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.568781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.568749    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 04:04:12.569199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.568893    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:04:12.569199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.568915    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:04:12.633328 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.633294    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 03:59:11 +0000 UTC" deadline="2027-12-23 17:00:56.248458688 +0000 UTC"
Jul 21 04:04:12.633328 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.633321    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12492h56m43.615141858s"
Jul 21 04:04:12.638114 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.638095    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.704012 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.703934    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:12.739120 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.739087    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.839575 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:12.839544    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-112.ec2.internal\" not found"
Jul 21 04:04:12.864711 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:12.864670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1399c85245541448fb6c7788aff95862.slice/crio-57cebf1a67753d170c8066daf1a215ba7465c22fa02ed28d5c432effb3831a28 WatchSource:0}: Error finding container 57cebf1a67753d170c8066daf1a215ba7465c22fa02ed28d5c432effb3831a28: Status 404 returned error can't find the container with id 57cebf1a67753d170c8066daf1a215ba7465c22fa02ed28d5c432effb3831a28
Jul 21 04:04:12.865162 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:12.865137    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f8e6bbb86a37842b41f2e25ac18265.slice/crio-898f56d74fa94fa4959eab6dc923f5e98f6f6ca5ad3204fe6de053cc5f39829d WatchSource:0}: Error finding container 898f56d74fa94fa4959eab6dc923f5e98f6f6ca5ad3204fe6de053cc5f39829d: Status 404 returned error can't find the container with id 898f56d74fa94fa4959eab6dc923f5e98f6f6ca5ad3204fe6de053cc5f39829d
Jul 21 04:04:12.870149 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.870135    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:04:12.891501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.891481    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:12.933367 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.933330    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.941817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.941798    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:12.942901 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.942889    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal"
Jul 21 04:04:12.952472 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:12.952459    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:13.463935 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.463901    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:13.611785 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.611746    2578 apiserver.go:52] "Watching apiserver"
Jul 21 04:04:13.621698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.621662    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 04:04:13.622768 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.622738    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-gjrmc","openshift-multus/network-metrics-daemon-t5d7v","openshift-network-diagnostics/network-check-target-p6jc5","kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sbgz8","openshift-dns/node-resolver-25cfk","openshift-image-registry/node-ca-5gsms","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal","openshift-network-operator/iptables-alerter-2wd4x","openshift-ovn-kubernetes/ovnkube-node-2rvqh","kube-system/global-pull-secret-syncer-5d5vs","kube-system/konnectivity-agent-5kfhb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7","openshift-multus/multus-additional-cni-plugins-tn6br"]
Jul 21 04:04:13.624315 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.624293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.626513 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.626493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.627445 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 04:04:13.627546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627457    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 04:04:13.627546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627493    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 04:04:13.627848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvlh7\""
Jul 21 04:04:13.627848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627729    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.627848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.627697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 04:04:13.628316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.628297    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.628875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.628854    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.629191 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.629175    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 04:04:13.629412 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.629380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2fzw7\""
Jul 21 04:04:13.629584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.629559    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.631752 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.631734    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:13.631829 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.631799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:13.632979 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.632954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.633989 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.633971    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:13.634893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.634871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 04:04:13.635106 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.635090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7hbh\""
Jul 21 04:04:13.635277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.635250    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 04:04:13.635393 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.635320    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.635393 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.635344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.635648 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.635629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 04:04:13.636494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.636473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.637689 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.637659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.638504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.638483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.638605 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.638564    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wnc9\""
Jul 21 04:04:13.638835 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.638816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.639066 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.639049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.639895 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.639877    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.640019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.640004    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.640093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.640052    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhwkm\""
Jul 21 04:04:13.640430 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.640406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.641377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.641361    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.641624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.641606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 04:04:13.641809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.641793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqqqw\""
Jul 21 04:04:13.642005 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.641990    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.642743 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.642715    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 04:04:13.642932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.642915    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 04:04:13.643141 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643125    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-sys\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-lib-modules\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-host\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-bin\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-netd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-env-overrides\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.643523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643506    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jnpwg\""
Jul 21 04:04:13.645674 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.645655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.645767 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.645749    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:13.645923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.645896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.646827 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.646807    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:13.648388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.647971    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 04:04:13.648857 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.648088    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-65rwg\""
Jul 21 04:04:13.654822 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.643492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktt44\" (UniqueName: \"kubernetes.io/projected/2a248879-e692-42a9-add8-eaad80c2fffe-kube-api-access-ktt44\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-tuned\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-ovn\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.655184    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-slash\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-systemd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-var-lib-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tfc\" (UniqueName: \"kubernetes.io/projected/a35a369c-812e-4839-bf49-d4f0883c3f28-kube-api-access-56tfc\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-log-socket\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-device-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-os-release\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-kubernetes\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.655584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.655545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-config\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-script-lib\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-socket-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.656426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-registration-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.656426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-sys-fs\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.656426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-system-cni-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.656657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-cnibin\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.656657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-binary-copy\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.656657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-systemd-units\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-node-log\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.656831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.656831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.656831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysconfig\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-var-lib-kubelet\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.656975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-tmp\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-etc-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.657359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwk9d\" (UniqueName: \"kubernetes.io/projected/4386a61f-d2a9-4e2f-af49-e887e5db76f6-kube-api-access-rwk9d\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.657359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkz8\" (UniqueName: \"kubernetes.io/projected/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kube-api-access-tfkz8\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.657359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.657359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-modprobe-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-conf\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-systemd\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.657944 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.658185 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.657929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-run\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.658337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.658319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-kubelet\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.658503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.658483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-netns\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.658602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.658586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.659843 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.659823    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 04:04:13.660067 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.660051    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhpm7\""
Jul 21 04:04:13.660778 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.660761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 04:04:13.665823 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.665805    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-45b4z"
Jul 21 04:04:13.673316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.673184    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-45b4z"
Jul 21 04:04:13.735189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.735128    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 04:04:13.759562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-device-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.759712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-kubernetes\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.759712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-netns\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.759712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-device-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.759712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-kubernetes\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.759712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-config\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-socket-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-registration-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-sys-fs\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-system-cni-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-binary-copy\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz97j\" (UniqueName: \"kubernetes.io/projected/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-kube-api-access-pz97j\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-os-release\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.759966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.759977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-kubelet-config\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-hostroot\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-multus-certs\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-var-lib-kubelet\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-tmp\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-config\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-dbus\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-bin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbgk\" (UniqueName: \"kubernetes.io/projected/b64567ae-1e94-46af-8c68-a17fb113add6-kube-api-access-kmbgk\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-conf\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-lib-modules\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-cnibin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhnns\" (UniqueName: \"kubernetes.io/projected/478a997c-c25d-420f-a8ca-cc85a0501f17-kube-api-access-mhnns\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-netns\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.760464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-multus\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-bin\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-env-overrides\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760561    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-tuned\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-multus-daemon-config\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-konnectivity-ca\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-socket-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-ovn\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-systemd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-registration-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-var-lib-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-sys-fs\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tfc\" (UniqueName: \"kubernetes.io/projected/a35a369c-812e-4839-bf49-d4f0883c3f28-kube-api-access-56tfc\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-log-socket\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.761256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-os-release\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-netns\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac37dc7e-b446-4e71-a506-8fd157f3a26c-host\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-system-cni-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac37dc7e-b446-4e71-a506-8fd157f3a26c-serviceca\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-lib-modules\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.760991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-bin\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-systemd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-conf-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-script-lib\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-cnibin\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.762250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-systemd\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-run\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-var-lib-kubelet\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-env-overrides\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysctl-conf\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-cnibin\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-var-lib-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-systemd\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-os-release\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-run-ovn\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-systemd-units\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-binary-copy\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-node-log\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-systemd-units\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dkx8\" (UniqueName: \"kubernetes.io/projected/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-kube-api-access-7dkx8\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-log-socket\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovnkube-script-lib\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-node-log\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-run\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.761904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysconfig\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-tmp-dir\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-sysconfig\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-socket-dir-parent\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-agent-certs\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a248879-e692-42a9-add8-eaad80c2fffe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-etc-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwk9d\" (UniqueName: \"kubernetes.io/projected/4386a61f-d2a9-4e2f-af49-e887e5db76f6-kube-api-access-rwk9d\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.763864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-etc-openvswitch\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkz8\" (UniqueName: \"kubernetes.io/projected/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kube-api-access-tfkz8\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-modprobe-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-host\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a248879-e692-42a9-add8-eaad80c2fffe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-modprobe-d\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-host\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-system-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.762970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-kubelet\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-sys\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-kubelet\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/478a997c-c25d-420f-a8ca-cc85a0501f17-iptables-alerter-script\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb6mm\" (UniqueName: \"kubernetes.io/projected/ac37dc7e-b446-4e71-a506-8fd157f3a26c-kube-api-access-lb6mm\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-hosts-file\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35a369c-812e-4839-bf49-d4f0883c3f28-sys\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.764684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-cni-binary-copy\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-k8s-cni-cncf-io\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-etc-kubernetes\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-netd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktt44\" (UniqueName: \"kubernetes.io/projected/2a248879-e692-42a9-add8-eaad80c2fffe-kube-api-access-ktt44\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/478a997c-c25d-420f-a8ca-cc85a0501f17-host-slash\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-cni-netd\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-kubelet\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-slash\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.763931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4386a61f-d2a9-4e2f-af49-e887e5db76f6-host-slash\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.764620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-etc-tuned\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.765225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.764777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a35a369c-812e-4839-bf49-d4f0883c3f28-tmp\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.765553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.765523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4386a61f-d2a9-4e2f-af49-e887e5db76f6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.767558 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.767421    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:13.767558 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.767445    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:13.767558 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.767461    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:13.767558 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.767522    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:14.267500222 +0000 UTC m=+3.017550715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:13.769585 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.769042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tfc\" (UniqueName: \"kubernetes.io/projected/a35a369c-812e-4839-bf49-d4f0883c3f28-kube-api-access-56tfc\") pod \"tuned-sbgz8\" (UID: \"a35a369c-812e-4839-bf49-d4f0883c3f28\") " pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.770113 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.770083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkz8\" (UniqueName: \"kubernetes.io/projected/e53b68cd-66c3-42d2-898a-3c8fadbd0b5d-kube-api-access-tfkz8\") pod \"aws-ebs-csi-driver-node-gfpf7\" (UID: \"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.770449 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.770430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwk9d\" (UniqueName: \"kubernetes.io/projected/4386a61f-d2a9-4e2f-af49-e887e5db76f6-kube-api-access-rwk9d\") pod \"ovnkube-node-2rvqh\" (UID: \"4386a61f-d2a9-4e2f-af49-e887e5db76f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.772379 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.772349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktt44\" (UniqueName: \"kubernetes.io/projected/2a248879-e692-42a9-add8-eaad80c2fffe-kube-api-access-ktt44\") pod \"multus-additional-cni-plugins-tn6br\" (UID: \"2a248879-e692-42a9-add8-eaad80c2fffe\") " pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.779295 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.779245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal" event={"ID":"79f8e6bbb86a37842b41f2e25ac18265","Type":"ContainerStarted","Data":"898f56d74fa94fa4959eab6dc923f5e98f6f6ca5ad3204fe6de053cc5f39829d"}
Jul 21 04:04:13.780362 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.780339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal" event={"ID":"1399c85245541448fb6c7788aff95862","Type":"ContainerStarted","Data":"57cebf1a67753d170c8066daf1a215ba7465c22fa02ed28d5c432effb3831a28"}
Jul 21 04:04:13.864694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz97j\" (UniqueName: \"kubernetes.io/projected/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-kube-api-access-pz97j\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.864694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-os-release\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-kubelet-config\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-hostroot\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-multus-certs\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-dbus\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-bin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbgk\" (UniqueName: \"kubernetes.io/projected/b64567ae-1e94-46af-8c68-a17fb113add6-kube-api-access-kmbgk\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-cnibin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhnns\" (UniqueName: \"kubernetes.io/projected/478a997c-c25d-420f-a8ca-cc85a0501f17-kube-api-access-mhnns\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-multus\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-multus-daemon-config\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.864932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-konnectivity-ca\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac37dc7e-b446-4e71-a506-8fd157f3a26c-host\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac37dc7e-b446-4e71-a506-8fd157f3a26c-serviceca\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.864987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-conf-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dkx8\" (UniqueName: \"kubernetes.io/projected/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-kube-api-access-7dkx8\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-tmp-dir\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-socket-dir-parent\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-agent-certs\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-system-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/478a997c-c25d-420f-a8ca-cc85a0501f17-iptables-alerter-script\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb6mm\" (UniqueName: \"kubernetes.io/projected/ac37dc7e-b446-4e71-a506-8fd157f3a26c-kube-api-access-lb6mm\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-hosts-file\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-cni-binary-copy\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-k8s-cni-cncf-io\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.865413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-k8s-cni-cncf-io\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-os-release\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-kubelet-config\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-hostroot\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-multus-certs\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9836f108-de52-4f85-a1c3-07bab73386f0-dbus\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:13.866102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.865969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-bin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866356 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-cnibin\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866455 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-etc-kubernetes\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/478a997c-c25d-420f-a8ca-cc85a0501f17-host-slash\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.866504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-kubelet\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-netns\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-cni-multus\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-run-netns\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-etc-kubernetes\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/478a997c-c25d-420f-a8ca-cc85a0501f17-host-slash\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.866753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-host-var-lib-kubelet\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.866858 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.866753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.867191 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.867142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-multus-daemon-config\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.867273 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.867241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-konnectivity-ca\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.867313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.867271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-socket-dir-parent\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.867313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.867293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac37dc7e-b446-4e71-a506-8fd157f3a26c-host\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.867737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.867678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac37dc7e-b446-4e71-a506-8fd157f3a26c-serviceca\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.867844 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.867773    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:13.867844 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.867832    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:14.367814881 +0000 UTC m=+3.117865361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:13.868055 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-multus-conf-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.868159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/478a997c-c25d-420f-a8ca-cc85a0501f17-iptables-alerter-script\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.868242 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.868200    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:13.868301 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:13.868266    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:14.368250349 +0000 UTC m=+3.118300838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:13.868342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-hosts-file\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.868342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64567ae-1e94-46af-8c68-a17fb113add6-system-cni-dir\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.868429 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-tmp-dir\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.868688 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.868667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64567ae-1e94-46af-8c68-a17fb113add6-cni-binary-copy\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.870098 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.870066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2d3c268-8495-48c9-bc5f-844bd6ae5e4f-agent-certs\") pod \"konnectivity-agent-5kfhb\" (UID: \"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f\") " pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:13.874121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.874095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbgk\" (UniqueName: \"kubernetes.io/projected/b64567ae-1e94-46af-8c68-a17fb113add6-kube-api-access-kmbgk\") pod \"multus-gjrmc\" (UID: \"b64567ae-1e94-46af-8c68-a17fb113add6\") " pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:13.874382 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.874367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz97j\" (UniqueName: \"kubernetes.io/projected/8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8-kube-api-access-pz97j\") pod \"node-resolver-25cfk\" (UID: \"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8\") " pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.874843 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.874827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhnns\" (UniqueName: \"kubernetes.io/projected/478a997c-c25d-420f-a8ca-cc85a0501f17-kube-api-access-mhnns\") pod \"iptables-alerter-2wd4x\" (UID: \"478a997c-c25d-420f-a8ca-cc85a0501f17\") " pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.876958 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.876940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb6mm\" (UniqueName: \"kubernetes.io/projected/ac37dc7e-b446-4e71-a506-8fd157f3a26c-kube-api-access-lb6mm\") pod \"node-ca-5gsms\" (UID: \"ac37dc7e-b446-4e71-a506-8fd157f3a26c\") " pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:13.877486 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.877465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dkx8\" (UniqueName: \"kubernetes.io/projected/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-kube-api-access-7dkx8\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:13.938203 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.938158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:13.956281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.956242    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7"
Jul 21 04:04:13.965166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.965140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tn6br"
Jul 21 04:04:13.969987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.969965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sbgz8"
Jul 21 04:04:13.976457 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.976435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-25cfk"
Jul 21 04:04:13.985001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.984981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wd4x"
Jul 21 04:04:13.992642 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:13.992587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gsms"
Jul 21 04:04:14.001284 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.001260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjrmc"
Jul 21 04:04:14.007891 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.007871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:14.069934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.069906    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:14.269839 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.269741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:14.270002 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.269897    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:14.270002 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.269923    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:14.270002 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.269934    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:14.270002 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.269985    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.269971372 +0000 UTC m=+4.020021862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:14.370506 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.370468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:14.370669 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.370521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:14.370669 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.370625    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:14.370754 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.370625    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:14.370754 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.370689    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.370674439 +0000 UTC m=+4.120724915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:14.370754 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.370734    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.370714818 +0000 UTC m=+4.120765295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:14.676480 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.676384    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:13 +0000 UTC" deadline="2028-04-02 15:52:30.865113258 +0000 UTC"
Jul 21 04:04:14.676480 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.676424    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14915h48m16.188693696s"
Jul 21 04:04:14.760150 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.760121    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35a369c_812e_4839_bf49_d4f0883c3f28.slice/crio-64b0846e42d116fc03cd5e8203030a1ebf71f9494104342af94c93bec7beb4a7 WatchSource:0}: Error finding container 64b0846e42d116fc03cd5e8203030a1ebf71f9494104342af94c93bec7beb4a7: Status 404 returned error can't find the container with id 64b0846e42d116fc03cd5e8203030a1ebf71f9494104342af94c93bec7beb4a7
Jul 21 04:04:14.761103 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.761050    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac37dc7e_b446_4e71_a506_8fd157f3a26c.slice/crio-6608e8819c0cf8aa39c7be1bca116ec52db38aa8654db0fcafe49796242c4cd5 WatchSource:0}: Error finding container 6608e8819c0cf8aa39c7be1bca116ec52db38aa8654db0fcafe49796242c4cd5: Status 404 returned error can't find the container with id 6608e8819c0cf8aa39c7be1bca116ec52db38aa8654db0fcafe49796242c4cd5
Jul 21 04:04:14.762237 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.762132    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4386a61f_d2a9_4e2f_af49_e887e5db76f6.slice/crio-21d391b7265bac2ea183c16032d2c8147c8bc24a0b82b7b4ad65b253d84f6901 WatchSource:0}: Error finding container 21d391b7265bac2ea183c16032d2c8147c8bc24a0b82b7b4ad65b253d84f6901: Status 404 returned error can't find the container with id 21d391b7265bac2ea183c16032d2c8147c8bc24a0b82b7b4ad65b253d84f6901
Jul 21 04:04:14.763825 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.763798    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d3c268_8495_48c9_bc5f_844bd6ae5e4f.slice/crio-dc7b8e1a3d177c6e071569b11e017f8e18db4a4f08c070e5ec50907c053646bd WatchSource:0}: Error finding container dc7b8e1a3d177c6e071569b11e017f8e18db4a4f08c070e5ec50907c053646bd: Status 404 returned error can't find the container with id dc7b8e1a3d177c6e071569b11e017f8e18db4a4f08c070e5ec50907c053646bd
Jul 21 04:04:14.764513 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.764486    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478a997c_c25d_420f_a8ca_cc85a0501f17.slice/crio-c41317cd15efee08f484313412b9ebd30ae548bd933e09bc5e3b9a120b7edb4c WatchSource:0}: Error finding container c41317cd15efee08f484313412b9ebd30ae548bd933e09bc5e3b9a120b7edb4c: Status 404 returned error can't find the container with id c41317cd15efee08f484313412b9ebd30ae548bd933e09bc5e3b9a120b7edb4c
Jul 21 04:04:14.768790 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.768746    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64567ae_1e94_46af_8c68_a17fb113add6.slice/crio-1bd4bf2aa0656c905ed1e14101d171249fefbd96dfddd2e7ca1fa1d84ee87dc0 WatchSource:0}: Error finding container 1bd4bf2aa0656c905ed1e14101d171249fefbd96dfddd2e7ca1fa1d84ee87dc0: Status 404 returned error can't find the container with id 1bd4bf2aa0656c905ed1e14101d171249fefbd96dfddd2e7ca1fa1d84ee87dc0
Jul 21 04:04:14.770012 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.769987    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a248879_e692_42a9_add8_eaad80c2fffe.slice/crio-440399068e93b2370a6e690deb304568c82ee11abc44c551a6725a4cc9054718 WatchSource:0}: Error finding container 440399068e93b2370a6e690deb304568c82ee11abc44c551a6725a4cc9054718: Status 404 returned error can't find the container with id 440399068e93b2370a6e690deb304568c82ee11abc44c551a6725a4cc9054718
Jul 21 04:04:14.771590 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.771562    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53b68cd_66c3_42d2_898a_3c8fadbd0b5d.slice/crio-468a2abb9dc101f87f2c3397f9a76a1c5d8b13e326355c3aae6a7c72cdfe5591 WatchSource:0}: Error finding container 468a2abb9dc101f87f2c3397f9a76a1c5d8b13e326355c3aae6a7c72cdfe5591: Status 404 returned error can't find the container with id 468a2abb9dc101f87f2c3397f9a76a1c5d8b13e326355c3aae6a7c72cdfe5591
Jul 21 04:04:14.772117 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:14.772086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8cbd13_af9a_49c7_a363_6ea13f5f8bf8.slice/crio-dbb51a60281c7b44be61214f41d36bf41ad2085accab531e75196321489d29fe WatchSource:0}: Error finding container dbb51a60281c7b44be61214f41d36bf41ad2085accab531e75196321489d29fe: Status 404 returned error can't find the container with id dbb51a60281c7b44be61214f41d36bf41ad2085accab531e75196321489d29fe
Jul 21 04:04:14.774749 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.774636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:14.774812 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:14.774755    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:14.783557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.783528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerStarted","Data":"440399068e93b2370a6e690deb304568c82ee11abc44c551a6725a4cc9054718"}
Jul 21 04:04:14.784815 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.784787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7" event={"ID":"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d","Type":"ContainerStarted","Data":"468a2abb9dc101f87f2c3397f9a76a1c5d8b13e326355c3aae6a7c72cdfe5591"}
Jul 21 04:04:14.786308 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.786280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-25cfk" event={"ID":"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8","Type":"ContainerStarted","Data":"dbb51a60281c7b44be61214f41d36bf41ad2085accab531e75196321489d29fe"}
Jul 21 04:04:14.788079 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.788051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjrmc" event={"ID":"b64567ae-1e94-46af-8c68-a17fb113add6","Type":"ContainerStarted","Data":"1bd4bf2aa0656c905ed1e14101d171249fefbd96dfddd2e7ca1fa1d84ee87dc0"}
Jul 21 04:04:14.789508 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.789483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wd4x" event={"ID":"478a997c-c25d-420f-a8ca-cc85a0501f17","Type":"ContainerStarted","Data":"c41317cd15efee08f484313412b9ebd30ae548bd933e09bc5e3b9a120b7edb4c"}
Jul 21 04:04:14.790936 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.790910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sbgz8" event={"ID":"a35a369c-812e-4839-bf49-d4f0883c3f28","Type":"ContainerStarted","Data":"64b0846e42d116fc03cd5e8203030a1ebf71f9494104342af94c93bec7beb4a7"}
Jul 21 04:04:14.792966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.792848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gsms" event={"ID":"ac37dc7e-b446-4e71-a506-8fd157f3a26c","Type":"ContainerStarted","Data":"6608e8819c0cf8aa39c7be1bca116ec52db38aa8654db0fcafe49796242c4cd5"}
Jul 21 04:04:14.794107 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.794081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5kfhb" event={"ID":"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f","Type":"ContainerStarted","Data":"dc7b8e1a3d177c6e071569b11e017f8e18db4a4f08c070e5ec50907c053646bd"}
Jul 21 04:04:14.795430 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:14.795405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"21d391b7265bac2ea183c16032d2c8147c8bc24a0b82b7b4ad65b253d84f6901"}
Jul 21 04:04:15.281518 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.281198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:15.281518 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.281422    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:15.281518 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.281448    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:15.281518 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.281461    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:15.281841 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.281540    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:17.281519802 +0000 UTC m=+6.031570304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.382316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.382399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.382563    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.382676    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:17.382653977 +0000 UTC m=+6.132704470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.383178    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:15.383276 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.383236    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:17.383218926 +0000 UTC m=+6.133269405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:15.677692 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.677569    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:13 +0000 UTC" deadline="2028-01-16 02:33:29.512702116 +0000 UTC"
Jul 21 04:04:15.677692 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.677639    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13054h29m13.83506782s"
Jul 21 04:04:15.775406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.775371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:15.775594 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.775535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:15.775658 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.775621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:15.775779 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:15.775756    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:15.807201 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.807168    2578 generic.go:356] "Generic (PLEG): container finished" podID="79f8e6bbb86a37842b41f2e25ac18265" containerID="34fb8a04f001d0d94da5ee390537770d56b4caf17d9ed0b66d8a1e9cb9b9e672" exitCode=0
Jul 21 04:04:15.807393 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.807268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal" event={"ID":"79f8e6bbb86a37842b41f2e25ac18265","Type":"ContainerDied","Data":"34fb8a04f001d0d94da5ee390537770d56b4caf17d9ed0b66d8a1e9cb9b9e672"}
Jul 21 04:04:15.815719 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:15.815314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal" event={"ID":"1399c85245541448fb6c7788aff95862","Type":"ContainerStarted","Data":"5bb090359745c61aebf08ff51bcb81a7010ed018935e8300b7ed12964a3066aa"}
Jul 21 04:04:16.775824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:16.775297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:16.775824 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:16.775443    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:16.862694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:16.862655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal" event={"ID":"79f8e6bbb86a37842b41f2e25ac18265","Type":"ContainerStarted","Data":"8c88ebda0ac50cfd242fff71f18feac64128f79797d2dbcb4bf3517c7ea78626"}
Jul 21 04:04:16.885405 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:16.885330    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-112.ec2.internal" podStartSLOduration=3.885308638 podStartE2EDuration="3.885308638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:15.838275819 +0000 UTC m=+4.588326322" watchObservedRunningTime="2026-07-21 04:04:16.885308638 +0000 UTC m=+5.635359139"
Jul 21 04:04:17.303395 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:17.303234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:17.303601 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.303427    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:17.303601 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.303448    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:17.303601 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.303461    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:17.303601 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.303517    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:21.303498724 +0000 UTC m=+10.053549214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:17.403895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:17.403970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.404097    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.404161    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:21.404141536 +0000 UTC m=+10.154192095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.404587    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:17.404726 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.404647    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:21.404626771 +0000 UTC m=+10.154677267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:17.776745 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:17.776668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:17.777169 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.776787    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:17.777169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:17.777139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:17.777316 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:17.777251    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:18.775313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:18.775274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:18.775501 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:18.775389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:19.775818 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:19.775333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:19.775818 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:19.775470    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:19.778747 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:19.776452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:19.778747 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:19.776563    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:20.775094 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:20.775004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:20.775283 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:20.775136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:21.339646 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:21.339595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:21.340091 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.339820    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:21.340091 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.339841    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:21.340091 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.339854    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:21.340091 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.339914    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:29.339896267 +0000 UTC m=+18.089946757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:21.440163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:21.440111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:21.440377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:21.440191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:21.440377 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.440258    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:21.440377 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.440330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:29.440311082 +0000 UTC m=+18.190361557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:21.440377 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.440335    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:21.440609 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.440397    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:29.440379594 +0000 UTC m=+18.190430072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:21.775875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:21.775710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:21.786046 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.784304    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:21.786046 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:21.784346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:21.786046 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:21.784501    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:22.775179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:22.775150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:22.775644 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:22.775330    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:23.775406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:23.774904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:23.775406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:23.774931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:23.775406 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:23.775049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:23.775406 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:23.775192    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:24.774753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:24.774716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:24.774916 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:24.774847    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:25.775557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:25.775521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:25.776074 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:25.775665    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:25.776074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:25.775717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:25.776074 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:25.775813    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:26.774834 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:26.774790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:26.775031 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:26.774927    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:27.775234 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:27.775139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:27.775666 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:27.775300    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:27.775666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:27.775356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:27.775666 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:27.775470    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:28.775346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:28.775309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:28.775844 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:28.775445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:29.396822 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:29.396794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:29.396984 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.396932    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:29.396984 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.396948    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:29.396984 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.396958    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:29.397096 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.397004    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:45.396990282 +0000 UTC m=+34.147040771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:29.497073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:29.497045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:29.497200 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:29.497097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:29.497200 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.497185    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:29.497327 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.497204    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:29.497327 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.497259    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:45.497242686 +0000 UTC m=+34.247293173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:29.497327 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.497309    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:45.497267762 +0000 UTC m=+34.247318237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:29.774982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:29.774947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:29.774982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:29.774979    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:29.775171 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.775083    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:29.775171 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:29.775122    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:30.775424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:30.775384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:30.775824 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:30.775507    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:31.776121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:31.776087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:31.776577 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:31.776195    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:31.776577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:31.776262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:31.776577 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:31.776372    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:32.775112 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:32.775080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:32.775303 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:32.775185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:33.774891 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:33.774849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:33.775379 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:33.774974    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:33.775379 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:33.775035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:33.775379 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:33.775146    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:34.775168 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.774866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:34.775792 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:34.775272    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:34.904714 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.904679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sbgz8" event={"ID":"a35a369c-812e-4839-bf49-d4f0883c3f28","Type":"ContainerStarted","Data":"b98b1f87d84c73c3eb81d665b069567a451609726506c2bdd8c6e89913fc0b17"}
Jul 21 04:04:34.906005 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.905983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gsms" event={"ID":"ac37dc7e-b446-4e71-a506-8fd157f3a26c","Type":"ContainerStarted","Data":"3a37708a24622864ffc64bdda7af2be3eb7363b971e4af7eaa7a7a2ee4364494"}
Jul 21 04:04:34.907313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.907290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5kfhb" event={"ID":"c2d3c268-8495-48c9-bc5f-844bd6ae5e4f","Type":"ContainerStarted","Data":"933c39749e7c28cae226c62a9e07bdb7f1345f43e123cedda71c6457d54ee052"}
Jul 21 04:04:34.909829 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.909812    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:04:34.910134 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910111    2578 generic.go:356] "Generic (PLEG): container finished" podID="4386a61f-d2a9-4e2f-af49-e887e5db76f6" containerID="19ec419b0480d7cb1070e0da25ccf1bd549a93023ca78fee8b16edbbcfb18451" exitCode=1
Jul 21 04:04:34.910204 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"a9fc88ca68aa903b2331d4cda53ff879ced0ee91fbf5d44bdd8ec58888529ca9"}
Jul 21 04:04:34.910286 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"e3f349f83cd7aaa382efc99b877f266067d6dfeb71641ba64938f0c869592624"}
Jul 21 04:04:34.910340 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"3029e4cca5d22350a2e93aa32baa69d2b80f284197f24985b111ea30bc0bc85d"}
Jul 21 04:04:34.910393 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"0958e59525df77cdb85ee565ba4a6605241d30586cc3bf0480aedd0c67abe13f"}
Jul 21 04:04:34.910445 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerDied","Data":"19ec419b0480d7cb1070e0da25ccf1bd549a93023ca78fee8b16edbbcfb18451"}
Jul 21 04:04:34.910501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.910471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"57fa5d016ba0fe49b2d562a59efbf05dbf07d8416c0ccceee88e687a2e8ee488"}
Jul 21 04:04:34.911565 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.911547    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="5088a0b1770f9a3206fed80e703fc61ee12b70779b57ae43994ec95da4be75ee" exitCode=0
Jul 21 04:04:34.911647 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.911609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"5088a0b1770f9a3206fed80e703fc61ee12b70779b57ae43994ec95da4be75ee"}
Jul 21 04:04:34.913041 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.913021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7" event={"ID":"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d","Type":"ContainerStarted","Data":"82c5b21025df2062cefe0b81a314cd995e8933ba1422aaf7ab952ccde905b444"}
Jul 21 04:04:34.914399 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.914380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-25cfk" event={"ID":"8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8","Type":"ContainerStarted","Data":"78dab7b0ca243ff39e9e0247937f4677218c740c2e71e902a1a48c4df0a7bb0c"}
Jul 21 04:04:34.915709 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.915690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjrmc" event={"ID":"b64567ae-1e94-46af-8c68-a17fb113add6","Type":"ContainerStarted","Data":"3896010fda237f54380875f50540cce67649082e98300a7ff9d65c828e41f2b0"}
Jul 21 04:04:34.935033 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.934987    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-112.ec2.internal" podStartSLOduration=21.934973322 podStartE2EDuration="21.934973322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:16.88645333 +0000 UTC m=+5.636503831" watchObservedRunningTime="2026-07-21 04:04:34.934973322 +0000 UTC m=+23.685023819"
Jul 21 04:04:34.935549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:34.935523    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sbgz8" podStartSLOduration=3.64069319 podStartE2EDuration="22.93551684s" totalImagesPullingTime="19.29482365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.93542348 +0000 UTC m=+23.685473977" watchObservedRunningTime="2026-07-21 04:04:34.93551684 +0000 UTC m=+23.685567337"
Jul 21 04:04:35.004888 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.004839    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gjrmc" podStartSLOduration=3.666005552 podStartE2EDuration="23.004822237s" totalImagesPullingTime="19.338816685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.960125488 +0000 UTC m=+23.710175985" watchObservedRunningTime="2026-07-21 04:04:35.004822237 +0000 UTC m=+23.754872734"
Jul 21 04:04:35.032934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.032878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5kfhb" podStartSLOduration=3.741080242 podStartE2EDuration="23.03285947s" totalImagesPullingTime="19.291779228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.005151879 +0000 UTC m=+23.755202377" watchObservedRunningTime="2026-07-21 04:04:35.03285947 +0000 UTC m=+23.782909967"
Jul 21 04:04:35.033427 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.033395    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-25cfk" podStartSLOduration=3.748471379 podStartE2EDuration="23.033386291s" totalImagesPullingTime="19.284914912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.033168679 +0000 UTC m=+23.783219178" watchObservedRunningTime="2026-07-21 04:04:35.033386291 +0000 UTC m=+23.783436787"
Jul 21 04:04:35.133403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.133336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5gsms" podStartSLOduration=3.824407399 podStartE2EDuration="23.1333136s" totalImagesPullingTime="19.308906201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.082371267 +0000 UTC m=+23.832421763" watchObservedRunningTime="2026-07-21 04:04:35.1333136 +0000 UTC m=+23.883364098"
Jul 21 04:04:35.763154 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.763130    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 04:04:35.778518 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.778498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:35.778518 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.778515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:35.778988 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:35.778601    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:35.778988 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:35.778751    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:35.920082 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.919998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7" event={"ID":"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d","Type":"ContainerStarted","Data":"9f8a4f2c5310b63cdc75b93770587f7f3b1380db368ff2bfcbeca5672a8063ef"}
Jul 21 04:04:35.921806 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:35.921744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wd4x" event={"ID":"478a997c-c25d-420f-a8ca-cc85a0501f17","Type":"ContainerStarted","Data":"ae68391c072641f6364a15f281ac3ccb774d2b4949c54ab83664aec50281fd48"}
Jul 21 04:04:36.708388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:36.708261    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T04:04:35.7631523Z","UUID":"a8a90e2d-0871-4ebe-9167-de3e7a787225","Handler":null,"Name":"","Endpoint":""}
Jul 21 04:04:36.709969 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:36.709937    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 04:04:36.710115 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:36.709986    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 04:04:36.775000 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:36.774974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:36.775162 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:36.775091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:37.775073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.774791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:37.775614 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.774876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:37.775614 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:37.775145    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:37.775614 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:37.775548    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:37.931432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.931396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7" event={"ID":"e53b68cd-66c3-42d2-898a-3c8fadbd0b5d","Type":"ContainerStarted","Data":"c7ab41145458f3cda9aeefdc3f77a3856e3841aebec0f9f59822540c6538e7e9"}
Jul 21 04:04:37.934949 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.934929    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:04:37.935336 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.935314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"a939e500b302ff4994d420543b23cb60964fe7a7b4ead89420f6389ad603f970"}
Jul 21 04:04:37.968368 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.968308    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2wd4x" podStartSLOduration=6.655798526 podStartE2EDuration="25.96829078s" totalImagesPullingTime="19.312492254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.944427465 +0000 UTC m=+24.694477963" watchObservedRunningTime="2026-07-21 04:04:37.96829078 +0000 UTC m=+26.718341276"
Jul 21 04:04:37.968688 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:37.968661    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfpf7" podStartSLOduration=3.7311514260000003 podStartE2EDuration="25.968650213s" totalImagesPullingTime="22.237498787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:37.968464234 +0000 UTC m=+26.718514732" watchObservedRunningTime="2026-07-21 04:04:37.968650213 +0000 UTC m=+26.718700711"
Jul 21 04:04:38.775223 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:38.775173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:38.775650 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:38.775299    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:39.204610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:39.204536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:39.205247 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:39.205228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:39.774809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:39.774777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:39.774989 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:39.774779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:39.774989 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:39.774908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:39.775108 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:39.775025    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:40.774945 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.774777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:40.775644 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:40.775036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:40.946265 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.946194    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:04:40.946629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.946602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"c8b28cbfa13ac7b7a5e21cb134f2a94a38ed8c935a3adafb421ad117d61afd29"}
Jul 21 04:04:40.946863 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.946838    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:40.947078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.947060    2578 scope.go:117] "RemoveContainer" containerID="19ec419b0480d7cb1070e0da25ccf1bd549a93023ca78fee8b16edbbcfb18451"
Jul 21 04:04:40.948568 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.948547    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="3f48907cacee8941c816412712edc93d2c7daa88f9a0a4d50fa8036db2929692" exitCode=0
Jul 21 04:04:40.948755 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.948592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"3f48907cacee8941c816412712edc93d2c7daa88f9a0a4d50fa8036db2929692"}
Jul 21 04:04:40.963626 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:40.963606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:41.776616 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.776585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:41.777193 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:41.776706    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:41.777193 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.776788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:41.777193 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:41.776898    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:41.954685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.954664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:04:41.955166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.955106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" event={"ID":"4386a61f-d2a9-4e2f-af49-e887e5db76f6","Type":"ContainerStarted","Data":"64bad6d0bdb3d07893a29fecf2550ff5370cee7a77acf2efcdf1268e03130c4e"}
Jul 21 04:04:41.959541 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.959385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:41.959541 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.959462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:41.977117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.977088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:04:41.996073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:41.996018    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh" podStartSLOduration=10.625730209 podStartE2EDuration="29.996003445s" totalImagesPullingTime="19.370273236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:41.994404796 +0000 UTC m=+30.744455294" watchObservedRunningTime="2026-07-21 04:04:41.996003445 +0000 UTC m=+30.746053941"
Jul 21 04:04:42.608619 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.608591    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:42.608807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.608696    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 04:04:42.609089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.609069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5kfhb"
Jul 21 04:04:42.703029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.703005    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5d5vs"]
Jul 21 04:04:42.703170 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.703103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:42.703235 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:42.703182    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:42.706073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.706047    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5d7v"]
Jul 21 04:04:42.706205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.706152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:42.706347 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:42.706324    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:42.709264 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.709199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6jc5"]
Jul 21 04:04:42.709339 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.709292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:42.709384 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:42.709363    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:42.959607 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.959527    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="b271a0f60bf0edab45514b063142f4facd7e3e2caf257d846a918e10a6d8c43b" exitCode=0
Jul 21 04:04:42.960020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:42.959611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"b271a0f60bf0edab45514b063142f4facd7e3e2caf257d846a918e10a6d8c43b"}
Jul 21 04:04:44.775032 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:44.774955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:44.775032 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:44.774986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:44.775032 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:44.774992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:44.775876 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:44.775056    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:44.775876 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:44.775133    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:44.775876 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:44.775196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:44.966722 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:44.966692    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="6f05a76f76f470bf4467faa03021b8b25dd9d78b0bf4175bb2da5d69c9c90d8a" exitCode=0
Jul 21 04:04:44.966884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:44.966751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"6f05a76f76f470bf4467faa03021b8b25dd9d78b0bf4175bb2da5d69c9c90d8a"}
Jul 21 04:04:45.417682 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:45.417645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:45.417819 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.417803    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:45.417877 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.417822    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:45.417877 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.417832    2578 projected.go:196] Error preparing data for projected volume kube-api-access-l2vn5 for pod openshift-network-diagnostics/network-check-target-p6jc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:45.417958 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.417887    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5 podName:5c02b0a6-cc32-4756-90f0-d8214d86ee26 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:17.417871794 +0000 UTC m=+66.167922269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2vn5" (UniqueName: "kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5") pod "network-check-target-p6jc5" (UID: "5c02b0a6-cc32-4756-90f0-d8214d86ee26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:45.518321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:45.518281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:45.518467 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:45.518342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:45.518467 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.518442    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:45.518467 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.518451    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:45.518587 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.518513    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:17.518495837 +0000 UTC m=+66.268546311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:45.518587 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:45.518527    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret podName:9836f108-de52-4f85-a1c3-07bab73386f0 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:17.518520474 +0000 UTC m=+66.268570949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret") pod "global-pull-secret-syncer-5d5vs" (UID: "9836f108-de52-4f85-a1c3-07bab73386f0") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:46.391255 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:46.391196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:46.524925 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:46.524886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:46.775441 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:46.775418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:46.775608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:46.775418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:46.775608 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:46.775521    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:04:46.775608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:46.775418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:46.775608 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:46.775586    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6jc5" podUID="5c02b0a6-cc32-4756-90f0-d8214d86ee26"
Jul 21 04:04:46.775732 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:46.775644    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5d5vs" podUID="9836f108-de52-4f85-a1c3-07bab73386f0"
Jul 21 04:04:47.071818 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.071748    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-112.ec2.internal" event="NodeReady"
Jul 21 04:04:47.071958 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.071877    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 04:04:47.122304 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.122270    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f868f4bb-q5gjt"]
Jul 21 04:04:47.127542 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.127518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.131870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.131842    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 04:04:47.132109 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.132094    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 04:04:47.132360 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.132344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 04:04:47.135824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.135747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mkcct\""
Jul 21 04:04:47.138432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.138410    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 04:04:47.158550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.158485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f868f4bb-q5gjt"]
Jul 21 04:04:47.159133 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.159112    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-czk4f"]
Jul 21 04:04:47.162845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.162822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.173902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.173884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:04:47.174415 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.174400    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 04:04:47.174643 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.174630    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 04:04:47.176650 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.176633    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w42qd"]
Jul 21 04:04:47.180572 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.180553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.183101 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.183079    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p2vsr\""
Jul 21 04:04:47.183309 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.183082    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 04:04:47.183458 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.183441    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 04:04:47.183521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.183441    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 04:04:47.189253 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.189233    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czk4f"]
Jul 21 04:04:47.195925 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.195905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w42qd"]
Jul 21 04:04:47.231521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxfv\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.231905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.231797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.332550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfv4\" (UniqueName: \"kubernetes.io/projected/a18c6999-0c76-4110-bfb4-2fc2386aec39-kube-api-access-lxfv4\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.332550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxfv\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0776a76e-e7c5-473d-8c8c-d71acc6df211-tmp-dir\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.332760    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:47.332776 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.332781    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.332903    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:47.832880299 +0000 UTC m=+36.582930793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwh8\" (UniqueName: \"kubernetes.io/projected/0776a76e-e7c5-473d-8c8c-d71acc6df211-kube-api-access-8xwh8\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a18c6999-0c76-4110-bfb4-2fc2386aec39-cert\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.332980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.333009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0776a76e-e7c5-473d-8c8c-d71acc6df211-config-volume\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.333198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.333158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.333530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.333505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.333733 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.333709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.336974 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.336854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.337083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.336862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.351151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.351121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.352278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.352261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxfv\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.415516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.415473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:47.434509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.434690 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfv4\" (UniqueName: \"kubernetes.io/projected/a18c6999-0c76-4110-bfb4-2fc2386aec39-kube-api-access-lxfv4\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.434690 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.434635    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.434690 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0776a76e-e7c5-473d-8c8c-d71acc6df211-tmp-dir\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.434690 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwh8\" (UniqueName: \"kubernetes.io/projected/0776a76e-e7c5-473d-8c8c-d71acc6df211-kube-api-access-8xwh8\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.434892 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.434701    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:47.934684781 +0000 UTC m=+36.684735256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.434892 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a18c6999-0c76-4110-bfb4-2fc2386aec39-cert\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.434892 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.434783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0776a76e-e7c5-473d-8c8c-d71acc6df211-config-volume\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.435621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.435560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0776a76e-e7c5-473d-8c8c-d71acc6df211-tmp-dir\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.435891 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.435875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0776a76e-e7c5-473d-8c8c-d71acc6df211-config-volume\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.437738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.437717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a18c6999-0c76-4110-bfb4-2fc2386aec39-cert\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.446731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.446705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfv4\" (UniqueName: \"kubernetes.io/projected/a18c6999-0c76-4110-bfb4-2fc2386aec39-kube-api-access-lxfv4\") pod \"ingress-canary-w42qd\" (UID: \"a18c6999-0c76-4110-bfb4-2fc2386aec39\") " pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.447965 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.447944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwh8\" (UniqueName: \"kubernetes.io/projected/0776a76e-e7c5-473d-8c8c-d71acc6df211-kube-api-access-8xwh8\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.492023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.491983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w42qd"
Jul 21 04:04:47.512187 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.512159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:47.643340 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.643307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w42qd"]
Jul 21 04:04:47.648439 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:04:47.648414    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18c6999_0c76_4110_bfb4_2fc2386aec39.slice/crio-692d6b1827ad826bb3b8446bd3e58e72ff1c744b556637241ddce87b718e9263 WatchSource:0}: Error finding container 692d6b1827ad826bb3b8446bd3e58e72ff1c744b556637241ddce87b718e9263: Status 404 returned error can't find the container with id 692d6b1827ad826bb3b8446bd3e58e72ff1c744b556637241ddce87b718e9263
Jul 21 04:04:47.838001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.837900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:47.838140 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.838039    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:47.838140 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.838056    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:04:47.838140 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.838107    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:48.838092583 +0000 UTC m=+37.588143059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:04:47.938559 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.938523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:47.938737 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.938712    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.938816 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:47.938805    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:48.938782529 +0000 UTC m=+37.688833010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.974747 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:47.974707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w42qd" event={"ID":"a18c6999-0c76-4110-bfb4-2fc2386aec39","Type":"ContainerStarted","Data":"692d6b1827ad826bb3b8446bd3e58e72ff1c744b556637241ddce87b718e9263"}
Jul 21 04:04:48.775771 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.775366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:04:48.775771 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.775407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:04:48.775771 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.775414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:04:48.778110 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778017    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:04:48.778697 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:04:48.778796 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:04:48.778796 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:04:48.778890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:04:48.778953 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.778901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:04:48.845857 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.845753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:48.846040 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:48.845920    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:48.846040 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:48.845945    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:04:48.846040 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:48.846008    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:50.845986006 +0000 UTC m=+39.596036499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:04:48.946803 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:48.946752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:48.946985 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:48.946894    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:48.946985 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:48.946957    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:50.94693778 +0000 UTC m=+39.696988278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:49.444110 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:49.444059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:49.529546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:49.529453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:50.862250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:50.862206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:50.862610 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:50.862335    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:50.862610 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:50.862348    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:04:50.862610 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:50.862401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:54.862386587 +0000 UTC m=+43.612437062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:04:50.953866 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:50.953826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:50.962758 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:50.962728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:50.962897 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:50.962840    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:50.962897 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:50.962890    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:54.962876512 +0000 UTC m=+43.712926986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:51.089577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.089546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:51.473186 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.472982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:51.578289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.578194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:51.986074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.986040    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="60a362991e7b0a9760f5e804bb3ab5f0e82c551d6ba0288722a803da1b45d066" exitCode=0
Jul 21 04:04:51.986453 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.986114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"60a362991e7b0a9760f5e804bb3ab5f0e82c551d6ba0288722a803da1b45d066"}
Jul 21 04:04:51.987538 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:51.987515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w42qd" event={"ID":"a18c6999-0c76-4110-bfb4-2fc2386aec39","Type":"ContainerStarted","Data":"b3d9c23b340f314eadfe617f50c586f89c5c593c3a10a16682e7c906057a20ef"}
Jul 21 04:04:52.106967 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:52.106915    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w42qd" podStartSLOduration=1.489797103 podStartE2EDuration="5.106900412s" totalImagesPullingTime="3.617103309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.106583911 +0000 UTC m=+40.856634407" watchObservedRunningTime="2026-07-21 04:04:52.106900412 +0000 UTC m=+40.856950908"
Jul 21 04:04:52.973884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:52.973849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:52.992661 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:52.992630    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a248879-e692-42a9-add8-eaad80c2fffe" containerID="41c38ce5af52362c136a1e3bcd1a1dafe0bd8825ad1b870dce66dbfc6d6d7d3d" exitCode=0
Jul 21 04:04:52.993048 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:52.992713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerDied","Data":"41c38ce5af52362c136a1e3bcd1a1dafe0bd8825ad1b870dce66dbfc6d6d7d3d"}
Jul 21 04:04:53.063893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:53.063865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:53.920386 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:53.920346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:53.998453 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:53.998417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tn6br" event={"ID":"2a248879-e692-42a9-add8-eaad80c2fffe","Type":"ContainerStarted","Data":"61bc5ae3b301a96d45111b6d5b55e32ed97623888cb477d7ace45c0973531214"}
Jul 21 04:04:54.024910 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.024853    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tn6br" podStartSLOduration=8.816589647 podStartE2EDuration="42.024831352s" totalImagesPullingTime="33.208241705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:54.023196393 +0000 UTC m=+42.773246884" watchObservedRunningTime="2026-07-21 04:04:54.024831352 +0000 UTC m=+42.774881850"
Jul 21 04:04:54.024910 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.024894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:54.130886 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.130848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:54.207775 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.207686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:54.887484 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.887452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:04:54.887686 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:54.887611    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:54.887686 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:54.887632    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:04:54.887812 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:54.887697    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:02.887676372 +0000 UTC m=+51.637726868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:04:54.925226 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.925177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:54.988034 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:54.987995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:04:54.988206 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:54.988151    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:54.988290 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:04:54.988234    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:02.988202133 +0000 UTC m=+51.738252609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:55.032017 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:55.031981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:55.308613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:55.308580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:55.404250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:55.404205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:04:57.913926 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:04:57.913891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:02.949390 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:02.949345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:05:02.949776 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:02.949501    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:02.949776 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:02.949520    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:05:02.949776 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:02.949576    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:18.949559484 +0000 UTC m=+67.699609959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:05:03.049848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:03.049797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:05:03.050029 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:03.049948    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:03.050077 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:03.050032    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:19.050016192 +0000 UTC m=+67.800066666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:05.731442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:05.731410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:05.792268 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:05.792235    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:09.116704 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:09.116664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:09.215172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:09.215133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:10.186364 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:10.186327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:10.324136 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:10.324108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:13.136550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:13.136517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:13.234349 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:13.234312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:13.972987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:13.972964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rvqh"
Jul 21 04:05:14.303097 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:14.303002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:14.408358 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:14.408319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:17.454345 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.454302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:05:17.457494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.457475    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:05:17.467333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.467315    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:05:17.479683 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.479654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vn5\" (UniqueName: \"kubernetes.io/projected/5c02b0a6-cc32-4756-90f0-d8214d86ee26-kube-api-access-l2vn5\") pod \"network-check-target-p6jc5\" (UID: \"5c02b0a6-cc32-4756-90f0-d8214d86ee26\") " pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:05:17.555150 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.555116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:05:17.555342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.555169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:05:17.558069 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.558045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:05:17.558174 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.558066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:05:17.566044 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:17.566019    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:05:17.566094 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:17.566088    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:21.566071425 +0000 UTC m=+130.316121900 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : secret "metrics-daemon-secret" not found
Jul 21 04:05:17.568253 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.568239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9836f108-de52-4f85-a1c3-07bab73386f0-original-pull-secret\") pod \"global-pull-secret-syncer-5d5vs\" (UID: \"9836f108-de52-4f85-a1c3-07bab73386f0\") " pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:05:17.599571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.599545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:05:17.605614 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.605594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5d5vs"
Jul 21 04:05:17.606680 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.606663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:05:17.756588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.756556    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6jc5"]
Jul 21 04:05:17.759889 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:05:17.759853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c02b0a6_cc32_4756_90f0_d8214d86ee26.slice/crio-b01ce6ce39c1f71bfe41672664850957e51002cc7d03328030776f677334eb1a WatchSource:0}: Error finding container b01ce6ce39c1f71bfe41672664850957e51002cc7d03328030776f677334eb1a: Status 404 returned error can't find the container with id b01ce6ce39c1f71bfe41672664850957e51002cc7d03328030776f677334eb1a
Jul 21 04:05:17.771040 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:17.771018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5d5vs"]
Jul 21 04:05:17.773731 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:05:17.773710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9836f108_de52_4f85_a1c3_07bab73386f0.slice/crio-7c32a574ab465464d4d9d0490597c20245acd68ec30d43758c473e6c082bdc4a WatchSource:0}: Error finding container 7c32a574ab465464d4d9d0490597c20245acd68ec30d43758c473e6c082bdc4a: Status 404 returned error can't find the container with id 7c32a574ab465464d4d9d0490597c20245acd68ec30d43758c473e6c082bdc4a
Jul 21 04:05:18.056420 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:18.056332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5d5vs" event={"ID":"9836f108-de52-4f85-a1c3-07bab73386f0","Type":"ContainerStarted","Data":"7c32a574ab465464d4d9d0490597c20245acd68ec30d43758c473e6c082bdc4a"}
Jul 21 04:05:18.057372 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:18.057346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6jc5" event={"ID":"5c02b0a6-cc32-4756-90f0-d8214d86ee26","Type":"ContainerStarted","Data":"b01ce6ce39c1f71bfe41672664850957e51002cc7d03328030776f677334eb1a"}
Jul 21 04:05:18.965471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:18.965431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:05:18.966011 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:18.965575    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:18.966011 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:18.965593    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:05:18.966011 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:18.965664    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:50.965643801 +0000 UTC m=+99.715694293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:05:19.066231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:19.066180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:05:19.066406 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:19.066360    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:19.066469 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:19.066418    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:51.066398812 +0000 UTC m=+99.816449286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:23.073562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:23.073519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6jc5" event={"ID":"5c02b0a6-cc32-4756-90f0-d8214d86ee26","Type":"ContainerStarted","Data":"fa7185269d561177ac47b2bb9aa78d1682d1dfe072e355c2f6c152ec788f2f3d"}
Jul 21 04:05:23.074018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:23.073653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:05:23.075027 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:23.075004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5d5vs" event={"ID":"9836f108-de52-4f85-a1c3-07bab73386f0","Type":"ContainerStarted","Data":"febcf89c52b6f9f8a96acd6746ccb175bcaf40e393db74a4cfc766f8336af763"}
Jul 21 04:05:23.101397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:23.101358    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p6jc5" podStartSLOduration=66.808631069 podStartE2EDuration="1m11.101346529s" totalImagesPullingTime="4.29271546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:23.099987239 +0000 UTC m=+71.850037735" watchObservedRunningTime="2026-07-21 04:05:23.101346529 +0000 UTC m=+71.851397004"
Jul 21 04:05:23.122002 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:23.121955    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5d5vs" podStartSLOduration=66.83591667 podStartE2EDuration="1m11.12194102s" totalImagesPullingTime="4.28602435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:23.120830284 +0000 UTC m=+71.870880781" watchObservedRunningTime="2026-07-21 04:05:23.12194102 +0000 UTC m=+71.871991517"
Jul 21 04:05:31.127674 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:31.127639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:31.240717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:31.240686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:05:50.986556 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:50.986519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:05:50.987050 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:50.986691    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:50.987050 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:50.986715    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:05:50.987050 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:50.986785    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:54.986764596 +0000 UTC m=+163.736815087 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:05:51.087825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:51.087781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:05:51.087989 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:51.087931    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:51.088036 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:05:51.088008    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:55.087991053 +0000 UTC m=+163.838041528 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:54.079593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:54.079562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p6jc5"
Jul 21 04:05:57.727313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.727281    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"]
Jul 21 04:05:57.729893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.729875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.732744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.732711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 04:05:57.732875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.732711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 04:05:57.732875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.732770    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 04:05:57.732875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.732832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 04:05:57.743376 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.743351    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"]
Jul 21 04:05:57.836124 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.836086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4jd6\" (UniqueName: \"kubernetes.io/projected/81973346-3c20-4ff9-b40d-93f69fff5e94-kube-api-access-c4jd6\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.836322 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.836139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81973346-3c20-4ff9-b40d-93f69fff5e94-tmp\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.836322 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.836165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81973346-3c20-4ff9-b40d-93f69fff5e94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.937432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.937387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81973346-3c20-4ff9-b40d-93f69fff5e94-tmp\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.937432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.937436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81973346-3c20-4ff9-b40d-93f69fff5e94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.937649 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.937499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4jd6\" (UniqueName: \"kubernetes.io/projected/81973346-3c20-4ff9-b40d-93f69fff5e94-kube-api-access-c4jd6\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.937790 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.937768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81973346-3c20-4ff9-b40d-93f69fff5e94-tmp\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.940111 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.940086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81973346-3c20-4ff9-b40d-93f69fff5e94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:57.945890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:57.945866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4jd6\" (UniqueName: \"kubernetes.io/projected/81973346-3c20-4ff9-b40d-93f69fff5e94-kube-api-access-c4jd6\") pod \"klusterlet-addon-workmgr-54664959b6-sbktr\" (UID: \"81973346-3c20-4ff9-b40d-93f69fff5e94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:58.038807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:58.038711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:05:58.170987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:58.170957    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"]
Jul 21 04:05:58.174582 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:05:58.174553    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81973346_3c20_4ff9_b40d_93f69fff5e94.slice/crio-71909fc762dc912efc4164147b1aa049834ca83714d5eeacf81f93664c8c2e87 WatchSource:0}: Error finding container 71909fc762dc912efc4164147b1aa049834ca83714d5eeacf81f93664c8c2e87: Status 404 returned error can't find the container with id 71909fc762dc912efc4164147b1aa049834ca83714d5eeacf81f93664c8c2e87
Jul 21 04:05:59.163057 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:05:59.163016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" event={"ID":"81973346-3c20-4ff9-b40d-93f69fff5e94","Type":"ContainerStarted","Data":"71909fc762dc912efc4164147b1aa049834ca83714d5eeacf81f93664c8c2e87"}
Jul 21 04:06:02.172423 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:02.172384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" event={"ID":"81973346-3c20-4ff9-b40d-93f69fff5e94","Type":"ContainerStarted","Data":"44844350b54a3d381cc272de8db9f8d2ca9e6e8ba12daa7707c7e98c4051a688"}
Jul 21 04:06:02.172979 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:02.172599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:06:02.174070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:02.174048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:06:02.190408 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:02.190345    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" podStartSLOduration=1.682269102 podStartE2EDuration="5.190327943s" totalImagesPullingTime="3.508058841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:06:02.189636131 +0000 UTC m=+110.939686628" watchObservedRunningTime="2026-07-21 04:06:02.190327943 +0000 UTC m=+110.940378442"
Jul 21 04:06:21.607329 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:21.607274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:06:21.607861 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:21.607435    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:06:21.607861 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:21.607510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:23.607491853 +0000 UTC m=+252.357542332 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : secret "metrics-daemon-secret" not found
Jul 21 04:06:50.139321 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:50.139272    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt" podUID="0b8ad917-c4e3-43fc-93c1-6d8417848586"
Jul 21 04:06:50.173899 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:50.173852    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-czk4f" podUID="0776a76e-e7c5-473d-8c8c-d71acc6df211"
Jul 21 04:06:50.296685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:50.296656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:06:50.296685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:50.296692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:06:51.789118 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:51.789075    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:06:55.042956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:55.042918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") pod \"image-registry-6f868f4bb-q5gjt\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") " pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:06:55.043364 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:55.043097    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:06:55.043364 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:55.043121    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f868f4bb-q5gjt: secret "image-registry-tls" not found
Jul 21 04:06:55.043364 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:55.043176    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls podName:0b8ad917-c4e3-43fc-93c1-6d8417848586 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:57.043161198 +0000 UTC m=+285.793211673 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls") pod "image-registry-6f868f4bb-q5gjt" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586") : secret "image-registry-tls" not found
Jul 21 04:06:55.143454 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:06:55.143414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:06:55.143611 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:55.143562    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:06:55.143654 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:06:55.143627    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls podName:0776a76e-e7c5-473d-8c8c-d71acc6df211 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:57.143609931 +0000 UTC m=+285.893660407 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls") pod "dns-default-czk4f" (UID: "0776a76e-e7c5-473d-8c8c-d71acc6df211") : secret "dns-default-metrics-tls" not found
Jul 21 04:07:05.777698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:07:05.777624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:08:02.172879 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:02.172827    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" podUID="81973346-3c20-4ff9-b40d-93f69fff5e94" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 21 04:08:02.471955 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:02.471867    2578 generic.go:356] "Generic (PLEG): container finished" podID="81973346-3c20-4ff9-b40d-93f69fff5e94" containerID="44844350b54a3d381cc272de8db9f8d2ca9e6e8ba12daa7707c7e98c4051a688" exitCode=1
Jul 21 04:08:02.471955 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:02.471940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" event={"ID":"81973346-3c20-4ff9-b40d-93f69fff5e94","Type":"ContainerDied","Data":"44844350b54a3d381cc272de8db9f8d2ca9e6e8ba12daa7707c7e98c4051a688"}
Jul 21 04:08:02.472302 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:02.472280    2578 scope.go:117] "RemoveContainer" containerID="44844350b54a3d381cc272de8db9f8d2ca9e6e8ba12daa7707c7e98c4051a688"
Jul 21 04:08:03.477604 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:03.477561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr" event={"ID":"81973346-3c20-4ff9-b40d-93f69fff5e94","Type":"ContainerStarted","Data":"3046a00b83f482283bf55dece1c494e886864a56c519871d695499520c3362f0"}
Jul 21 04:08:03.477973 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:03.477853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:08:03.478452 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:03.478422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54664959b6-sbktr"
Jul 21 04:08:23.656020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:23.655979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:08:23.656450 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:23.656104    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:08:23.656450 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:23.656180    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs podName:14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:25.656162094 +0000 UTC m=+374.406212571 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs") pod "network-metrics-daemon-t5d7v" (UID: "14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34") : secret "metrics-daemon-secret" not found
Jul 21 04:08:25.335910 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.335874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"]
Jul 21 04:08:25.338849 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.338833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.343757 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.343735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jc825\""
Jul 21 04:08:25.344156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.344134    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 04:08:25.344590 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.344572    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.344697 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.344588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.358045 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.358021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"]
Jul 21 04:08:25.427333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.427299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cl9p4"]
Jul 21 04:08:25.430360 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.430337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.433563 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.433544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.433662 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.433565    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.433711 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.433695    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 04:08:25.434400 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.434382    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 04:08:25.434574 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.434556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xrnvb\""
Jul 21 04:08:25.439496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.439477    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 04:08:25.452351 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.452331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cl9p4"]
Jul 21 04:08:25.469850 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.469822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpf9\" (UniqueName: \"kubernetes.io/projected/b65373a0-90f9-45c3-baf9-cdd3cddd5157-kube-api-access-gmpf9\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.469976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.469878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.571044 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpf9\" (UniqueName: \"kubernetes.io/projected/b65373a0-90f9-45c3-baf9-cdd3cddd5157-kube-api-access-gmpf9\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.571231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.571231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-config\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.571231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83346093-da8d-43e4-82e1-af27fb1b0591-serving-cert\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.571231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-trusted-ca\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.571231 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.571203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hkgq\" (UniqueName: \"kubernetes.io/projected/83346093-da8d-43e4-82e1-af27fb1b0591-kube-api-access-4hkgq\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.571421 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:25.571249    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 04:08:25.571421 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:25.571322    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls podName:b65373a0-90f9-45c3-baf9-cdd3cddd5157 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:26.071301241 +0000 UTC m=+254.821351718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kssgm" (UID: "b65373a0-90f9-45c3-baf9-cdd3cddd5157") : secret "samples-operator-tls" not found
Jul 21 04:08:25.581813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.581777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpf9\" (UniqueName: \"kubernetes.io/projected/b65373a0-90f9-45c3-baf9-cdd3cddd5157-kube-api-access-gmpf9\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:25.603664 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.603577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:25.671884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.671853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-config\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.671884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.671887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83346093-da8d-43e4-82e1-af27fb1b0591-serving-cert\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.672099 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.671902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-trusted-ca\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.672099 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.671920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hkgq\" (UniqueName: \"kubernetes.io/projected/83346093-da8d-43e4-82e1-af27fb1b0591-kube-api-access-4hkgq\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.672656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.672638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-config\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.672761 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.672743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83346093-da8d-43e4-82e1-af27fb1b0591-trusted-ca\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.674338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.674323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83346093-da8d-43e4-82e1-af27fb1b0591-serving-cert\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.680622 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.680601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hkgq\" (UniqueName: \"kubernetes.io/projected/83346093-da8d-43e4-82e1-af27fb1b0591-kube-api-access-4hkgq\") pod \"console-operator-565b7b569d-cl9p4\" (UID: \"83346093-da8d-43e4-82e1-af27fb1b0591\") " pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.692602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.692576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:25.739708 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.739674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:25.890702 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:25.890631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cl9p4"]
Jul 21 04:08:25.893578 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:08:25.893551    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83346093_da8d_43e4_82e1_af27fb1b0591.slice/crio-92a32479d6414c5c5225dae423efaf5ed835547e70ade93f36151d114af4605a WatchSource:0}: Error finding container 92a32479d6414c5c5225dae423efaf5ed835547e70ade93f36151d114af4605a: Status 404 returned error can't find the container with id 92a32479d6414c5c5225dae423efaf5ed835547e70ade93f36151d114af4605a
Jul 21 04:08:26.076189 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:26.076140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:26.076398 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:26.076307    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 04:08:26.076398 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:26.076381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls podName:b65373a0-90f9-45c3-baf9-cdd3cddd5157 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:27.076365005 +0000 UTC m=+255.826415479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kssgm" (UID: "b65373a0-90f9-45c3-baf9-cdd3cddd5157") : secret "samples-operator-tls" not found
Jul 21 04:08:26.547324 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:26.547253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" event={"ID":"83346093-da8d-43e4-82e1-af27fb1b0591","Type":"ContainerStarted","Data":"92a32479d6414c5c5225dae423efaf5ed835547e70ade93f36151d114af4605a"}
Jul 21 04:08:27.083779 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:27.083739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:27.083964 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:27.083871    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 04:08:27.083964 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:27.083936    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls podName:b65373a0-90f9-45c3-baf9-cdd3cddd5157 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:29.0839185 +0000 UTC m=+257.833968976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kssgm" (UID: "b65373a0-90f9-45c3-baf9-cdd3cddd5157") : secret "samples-operator-tls" not found
Jul 21 04:08:28.530735 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.530655    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:28.555918 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.555891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/0.log"
Jul 21 04:08:28.556054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.555934    2578 generic.go:356] "Generic (PLEG): container finished" podID="83346093-da8d-43e4-82e1-af27fb1b0591" containerID="bf7d8cef013af3488ebec21af7d76ba01dbd4bf6d910fbf39d664cfd630482e1" exitCode=255
Jul 21 04:08:28.556054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.555975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" event={"ID":"83346093-da8d-43e4-82e1-af27fb1b0591","Type":"ContainerDied","Data":"bf7d8cef013af3488ebec21af7d76ba01dbd4bf6d910fbf39d664cfd630482e1"}
Jul 21 04:08:28.556197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.556183    2578 scope.go:117] "RemoveContainer" containerID="bf7d8cef013af3488ebec21af7d76ba01dbd4bf6d910fbf39d664cfd630482e1"
Jul 21 04:08:28.630913 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:28.630877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:29.098318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.098286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:29.098481 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:29.098423    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 04:08:29.098521 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:29.098486    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls podName:b65373a0-90f9-45c3-baf9-cdd3cddd5157 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.098471062 +0000 UTC m=+261.848521536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kssgm" (UID: "b65373a0-90f9-45c3-baf9-cdd3cddd5157") : secret "samples-operator-tls" not found
Jul 21 04:08:29.560064 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560037    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/1.log"
Jul 21 04:08:29.560509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/0.log"
Jul 21 04:08:29.560554 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560506    2578 generic.go:356] "Generic (PLEG): container finished" podID="83346093-da8d-43e4-82e1-af27fb1b0591" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7" exitCode=255
Jul 21 04:08:29.560585 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" event={"ID":"83346093-da8d-43e4-82e1-af27fb1b0591","Type":"ContainerDied","Data":"f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"}
Jul 21 04:08:29.560613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560594    2578 scope.go:117] "RemoveContainer" containerID="bf7d8cef013af3488ebec21af7d76ba01dbd4bf6d910fbf39d664cfd630482e1"
Jul 21 04:08:29.560769 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:29.560753    2578 scope.go:117] "RemoveContainer" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"
Jul 21 04:08:29.560944 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:29.560925    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:08:30.564333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.564307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/1.log"
Jul 21 04:08:30.564812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.564690    2578 scope.go:117] "RemoveContainer" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"
Jul 21 04:08:30.564925 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:30.564902    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:08:30.677471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.677437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:30.692447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.692414    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"]
Jul 21 04:08:30.696464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.696442    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"
Jul 21 04:08:30.698884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.698864    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 04:08:30.698997 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.698864    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:30.698997 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.698944    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-swwvv\""
Jul 21 04:08:30.705463 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.705441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"]
Jul 21 04:08:30.776183 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.776140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:30.809220 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.809192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqr7f\" (UniqueName: \"kubernetes.io/projected/9517e07e-92e3-49b4-9ff7-901d4372d48a-kube-api-access-hqr7f\") pod \"migrator-7cc9c7ffd7-kg8pv\" (UID: \"9517e07e-92e3-49b4-9ff7-901d4372d48a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"
Jul 21 04:08:30.878854 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.878773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:30.910325 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.910292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqr7f\" (UniqueName: \"kubernetes.io/projected/9517e07e-92e3-49b4-9ff7-901d4372d48a-kube-api-access-hqr7f\") pod \"migrator-7cc9c7ffd7-kg8pv\" (UID: \"9517e07e-92e3-49b4-9ff7-901d4372d48a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"
Jul 21 04:08:30.917976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:30.917952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqr7f\" (UniqueName: \"kubernetes.io/projected/9517e07e-92e3-49b4-9ff7-901d4372d48a-kube-api-access-hqr7f\") pod \"migrator-7cc9c7ffd7-kg8pv\" (UID: \"9517e07e-92e3-49b4-9ff7-901d4372d48a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"
Jul 21 04:08:31.005022 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.004989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"
Jul 21 04:08:31.127650 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.127620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv"]
Jul 21 04:08:31.130142 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:08:31.130068    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9517e07e_92e3_49b4_9ff7_901d4372d48a.slice/crio-1f16a521ca8bfd2c7b4ddd926b1a4c47b1db3bd4d30bd7d343aae47f64300ed8 WatchSource:0}: Error finding container 1f16a521ca8bfd2c7b4ddd926b1a4c47b1db3bd4d30bd7d343aae47f64300ed8: Status 404 returned error can't find the container with id 1f16a521ca8bfd2c7b4ddd926b1a4c47b1db3bd4d30bd7d343aae47f64300ed8
Jul 21 04:08:31.300915 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.300885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:31.358651 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.358614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:31.519671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.519640    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zhw48"]
Jul 21 04:08:31.523726 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.523710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.526432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.526412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 04:08:31.526432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.526427    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nz9gm\""
Jul 21 04:08:31.526563 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.526471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 04:08:31.527031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.527018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 04:08:31.527071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.527048    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 04:08:31.537733 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.537712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zhw48"]
Jul 21 04:08:31.543557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.543535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:31.567716 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.567691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv" event={"ID":"9517e07e-92e3-49b4-9ff7-901d4372d48a","Type":"ContainerStarted","Data":"1f16a521ca8bfd2c7b4ddd926b1a4c47b1db3bd4d30bd7d343aae47f64300ed8"}
Jul 21 04:08:31.604520 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.604475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:31.616624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.616600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25tc\" (UniqueName: \"kubernetes.io/projected/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-api-access-c25tc\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.616717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.616630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.616717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.616711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.616784 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.616739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92f67ec0-5e04-48f0-8253-d483456ffa07-data-volume\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.616829 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.616811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92f67ec0-5e04-48f0-8253-d483456ffa07-crio-socket\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.717882 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.717845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.717882 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.717888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92f67ec0-5e04-48f0-8253-d483456ffa07-data-volume\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.718046 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.717914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92f67ec0-5e04-48f0-8253-d483456ffa07-crio-socket\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.718046 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.717972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92f67ec0-5e04-48f0-8253-d483456ffa07-crio-socket\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.718046 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:31.717989    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.718046 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:31.718040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.218026097 +0000 UTC m=+260.968076572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.718179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.718064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25tc\" (UniqueName: \"kubernetes.io/projected/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-api-access-c25tc\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.718179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.718088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.718179 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:31.718174    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.718343 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:31.718245    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.218206556 +0000 UTC m=+260.968257031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.718343 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.718241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92f67ec0-5e04-48f0-8253-d483456ffa07-data-volume\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.726878 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.726844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25tc\" (UniqueName: \"kubernetes.io/projected/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-api-access-c25tc\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:31.796634 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.796556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:31.897005 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:31.896967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:32.011869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:32.011828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:32.109091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:32.109016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:32.224370 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:32.224338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:32.224556 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:32.224410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:32.224556 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:32.224484    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:32.224556 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:32.224521    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:32.224707 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:32.224567    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.224545497 +0000 UTC m=+261.974595981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:32.224707 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:32.224588    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.224578611 +0000 UTC m=+261.974629090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:32.572292 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:32.572263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv" event={"ID":"9517e07e-92e3-49b4-9ff7-901d4372d48a","Type":"ContainerStarted","Data":"b315a7ad1119bdeb4a2c2452771ed2517186f7c206b3f36c366dc9cb7655230f"}
Jul 21 04:08:33.133404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.133358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:33.133587 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.133513    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 04:08:33.133587 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.133574    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls podName:b65373a0-90f9-45c3-baf9-cdd3cddd5157 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:41.133559638 +0000 UTC m=+269.883610114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kssgm" (UID: "b65373a0-90f9-45c3-baf9-cdd3cddd5157") : secret "samples-operator-tls" not found
Jul 21 04:08:33.234251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.234143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:33.234416 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.234267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:33.234416 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.234320    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.234416 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.234357    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.234416 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.234382    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.234366208 +0000 UTC m=+263.984416682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.234416 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:33.234405    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.234390091 +0000 UTC m=+263.984440565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.577295 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.577254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv" event={"ID":"9517e07e-92e3-49b4-9ff7-901d4372d48a","Type":"ContainerStarted","Data":"82e4fe909488b3fe4798cde09079a3b9906520a6d2ae057c9303f92dd8515ff4"}
Jul 21 04:08:33.595727 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.595682    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kg8pv" podStartSLOduration=2.249436454 podStartE2EDuration="3.595669718s" totalImagesPullingTime="1.346233264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:33.595476594 +0000 UTC m=+262.345527090" watchObservedRunningTime="2026-07-21 04:08:33.595669718 +0000 UTC m=+262.345720215"
Jul 21 04:08:33.647044 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.646993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:33.744594 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:33.744567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:34.092957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:34.092930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-25cfk_8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8/dns-node-resolver/0.log"
Jul 21 04:08:34.617007 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:34.616956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:35.092685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.092657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gsms_ac37dc7e-b446-4e71-a506-8fd157f3a26c/node-ca/0.log"
Jul 21 04:08:35.251936 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.251898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:35.252093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.251991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:35.252093 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:35.252025    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.252163 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:35.252098    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.252081557 +0000 UTC m=+268.002132032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.252163 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:35.252135    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.252273 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:35.252188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.252176119 +0000 UTC m=+268.002226598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.740291 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.740256    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:35.740659 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.740312    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:35.740659 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:35.740617    2578 scope.go:117] "RemoveContainer" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"
Jul 21 04:08:35.740775 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:35.740756    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:08:36.292330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:36.292296    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w42qd_a18c6999-0c76-4110-bfb4-2fc2386aec39/serve-healthcheck-canary/0.log"
Jul 21 04:08:36.492964 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:36.492934    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kg8pv_9517e07e-92e3-49b4-9ff7-901d4372d48a/migrator/0.log"
Jul 21 04:08:36.692679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:36.692654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kg8pv_9517e07e-92e3-49b4-9ff7-901d4372d48a/graceful-termination/0.log"
Jul 21 04:08:37.082001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.081922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:37.183125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.183087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:37.510316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.510285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:37.623422 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.623380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:37.729137 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.729107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:37.829686 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:37.829597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:38.793184 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:38.793137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:39.183363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.183318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:39.281194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.281138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:39.281391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.281269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:39.281391 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:39.281280    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:39.281472 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:39.281398    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.281382033 +0000 UTC m=+276.031432510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:39.281472 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:39.281406    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:39.281472 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:39.281455    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.281442143 +0000 UTC m=+276.031492619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:39.416450 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.416412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:39.583039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.582954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:39.836346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.836247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:39.994934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:39.994895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:40.786359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:40.786324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:40.984609 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:40.984580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:41.035778 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.035739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:41.195975 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.195944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:41.198543 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.198520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b65373a0-90f9-45c3-baf9-cdd3cddd5157-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kssgm\" (UID: \"b65373a0-90f9-45c3-baf9-cdd3cddd5157\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:41.207504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.207471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:41.247546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.247504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"
Jul 21 04:08:41.266731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.266703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:41.376957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.376920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm"]
Jul 21 04:08:41.601767 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.601687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm" event={"ID":"b65373a0-90f9-45c3-baf9-cdd3cddd5157","Type":"ContainerStarted","Data":"657c293128e353d9a4dcddc7a2c9a61499365859eb9a770be36a30c8bb8b3dbe"}
Jul 21 04:08:41.661550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:41.661513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:42.187016 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:42.186968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:42.781318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:42.781283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:42.984353 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:42.984307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:43.185232 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:43.185185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:43.587828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:43.587734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:43.688809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:43.688770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:43.881400 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:43.881325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:44.214774 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.214734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:44.589055 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.588965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:44.612601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.612574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm" event={"ID":"b65373a0-90f9-45c3-baf9-cdd3cddd5157","Type":"ContainerStarted","Data":"10a56ca00b1748195799454f0c0c70901a52c08d4c3988e083ce4d3052b147d2"}
Jul 21 04:08:44.612723 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.612633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm" event={"ID":"b65373a0-90f9-45c3-baf9-cdd3cddd5157","Type":"ContainerStarted","Data":"b1d3648a1bdb9f253721aaef5052851ec4f6bc45e83a11105801d421902030f7"}
Jul 21 04:08:44.628677 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.628631    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kssgm" podStartSLOduration=17.091586098 podStartE2EDuration="19.628610958s" totalImagesPullingTime="2.53702486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:44.62769898 +0000 UTC m=+273.377749473" watchObservedRunningTime="2026-07-21 04:08:44.628610958 +0000 UTC m=+273.378661454"
Jul 21 04:08:44.980203 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:44.980159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:45.187524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:45.187487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:45.784922 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:45.784881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:46.024103 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:46.024047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:46.186975 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:46.186948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:46.584490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:46.584398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:46.787847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:46.787818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:47.187177 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.187145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:47.343404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.343364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:47.343527 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.343431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:47.343578 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:47.343558    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:47.343628 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:47.343618    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls podName:92f67ec0-5e04-48f0-8253-d483456ffa07 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:03.343600452 +0000 UTC m=+292.093650927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zhw48" (UID: "92f67ec0-5e04-48f0-8253-d483456ffa07") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:47.343884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.343861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92f67ec0-5e04-48f0-8253-d483456ffa07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:08:47.584667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.584583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:47.775230 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.775183    2578 scope.go:117] "RemoveContainer" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"
Jul 21 04:08:47.784158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:47.784131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:48.625737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.625711    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:08:48.626095 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.626081    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/1.log"
Jul 21 04:08:48.626139 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.626112    2578 generic.go:356] "Generic (PLEG): container finished" podID="83346093-da8d-43e4-82e1-af27fb1b0591" containerID="4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8" exitCode=255
Jul 21 04:08:48.626178 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.626161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" event={"ID":"83346093-da8d-43e4-82e1-af27fb1b0591","Type":"ContainerDied","Data":"4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8"}
Jul 21 04:08:48.626227 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.626205    2578 scope.go:117] "RemoveContainer" containerID="f1de44fed9814d99b27c40ad831e8d95f4a96a936895f24e309b3ab35bf34ad7"
Jul 21 04:08:48.626520 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:48.626503    2578 scope.go:117] "RemoveContainer" containerID="4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8"
Jul 21 04:08:48.626684 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:48.626666    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:08:49.089536 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:49.089503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:49.150108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:49.150074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:49.421321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:49.421281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:49.476031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:49.476001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:49.631068 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:49.631040    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:08:53.080640 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.080604    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f868f4bb-q5gjt"]
Jul 21 04:08:53.081010 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:53.080828    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt" podUID="0b8ad917-c4e3-43fc-93c1-6d8417848586"
Jul 21 04:08:53.141836 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.141805    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-586645f5c4-5mp66"]
Jul 21 04:08:53.145890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.145873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.156671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.156644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-586645f5c4-5mp66"]
Jul 21 04:08:53.230415 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.230379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:53.291337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srrq8\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-kube-api-access-srrq8\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291341    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-tls\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291529 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-installation-pull-secrets\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291529 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-trusted-ca\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291529 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-ca-trust-extracted\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-certificates\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-image-registry-private-configuration\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.291621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.291587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-bound-sa-token\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.297437 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:53.297404    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-czk4f" podUID="0776a76e-e7c5-473d-8c8c-d71acc6df211"
Jul 21 04:08:53.334639 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.334560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:53.392044 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srrq8\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-kube-api-access-srrq8\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392150 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-tls\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392150 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-installation-pull-secrets\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392150 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-trusted-ca\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-ca-trust-extracted\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-certificates\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392427 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-image-registry-private-configuration\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392427 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-bound-sa-token\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.392683 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.392649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-ca-trust-extracted\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.393126 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.393103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-certificates\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.393237 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.393177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-trusted-ca\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.394751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.394730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-installation-pull-secrets\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.395290 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.395268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-registry-tls\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.395410 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.395379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-image-registry-private-configuration\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.406879 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.406839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-bound-sa-token\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.409581 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.409562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srrq8\" (UniqueName: \"kubernetes.io/projected/5bc40118-71ce-4d00-9fd7-3d65fc53c5dd-kube-api-access-srrq8\") pod \"image-registry-586645f5c4-5mp66\" (UID: \"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd\") " pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.457782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.457753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mkcct\""
Jul 21 04:08:53.465493 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.465472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:53.610625 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.610543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-586645f5c4-5mp66"]
Jul 21 04:08:53.613195 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:08:53.613170    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc40118_71ce_4d00_9fd7_3d65fc53c5dd.slice/crio-97b83ecb396ceb4e1999b5a2f5d5bbafbf8977a2829726f29396f83a31ef8bf2 WatchSource:0}: Error finding container 97b83ecb396ceb4e1999b5a2f5d5bbafbf8977a2829726f29396f83a31ef8bf2: Status 404 returned error can't find the container with id 97b83ecb396ceb4e1999b5a2f5d5bbafbf8977a2829726f29396f83a31ef8bf2
Jul 21 04:08:53.643947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.643912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586645f5c4-5mp66" event={"ID":"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd","Type":"ContainerStarted","Data":"97b83ecb396ceb4e1999b5a2f5d5bbafbf8977a2829726f29396f83a31ef8bf2"}
Jul 21 04:08:53.643947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.643941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:08:53.644157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.644124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:08:53.653421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.653394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:08:53.694885 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.694850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rxfv\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.694885 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.694890    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.694932    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.694958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695058    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration\") pod \"0b8ad917-c4e3-43fc-93c1-6d8417848586\" (UID: \"0b8ad917-c4e3-43fc-93c1-6d8417848586\") "
Jul 21 04:08:53.695458 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695424    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:08:53.695531 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:08:53.695916 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.695828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:08:53.697549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.697518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:08:53.697654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.697578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:08:53.697654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.697606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv" (OuterVolumeSpecName: "kube-api-access-9rxfv") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "kube-api-access-9rxfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:08:53.697654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.697619    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0b8ad917-c4e3-43fc-93c1-6d8417848586" (UID: "0b8ad917-c4e3-43fc-93c1-6d8417848586"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:08:53.795720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795690    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-installation-pull-secrets\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795716    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b8ad917-c4e3-43fc-93c1-6d8417848586-ca-trust-extracted\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795725    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-certificates\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795920 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795734    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b8ad917-c4e3-43fc-93c1-6d8417848586-image-registry-private-configuration\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795920 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795743    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rxfv\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-kube-api-access-9rxfv\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795920 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795751    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-bound-sa-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:53.795920 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:53.795759    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b8ad917-c4e3-43fc-93c1-6d8417848586-trusted-ca\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:54.647994 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.647964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f868f4bb-q5gjt"
Jul 21 04:08:54.648452 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.647957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586645f5c4-5mp66" event={"ID":"5bc40118-71ce-4d00-9fd7-3d65fc53c5dd","Type":"ContainerStarted","Data":"d392394db65922f3feb8a4e1da3b43a71f89c25255d0e75e0c7b0e91af116e28"}
Jul 21 04:08:54.670273 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.670202    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-586645f5c4-5mp66" podStartSLOduration=1.670182333 podStartE2EDuration="1.670182333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:54.669642895 +0000 UTC m=+283.419693392" watchObservedRunningTime="2026-07-21 04:08:54.670182333 +0000 UTC m=+283.420232831"
Jul 21 04:08:54.699462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.699428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f868f4bb-q5gjt"]
Jul 21 04:08:54.703484 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.703461    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f868f4bb-q5gjt"]
Jul 21 04:08:54.801260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:54.801231    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b8ad917-c4e3-43fc-93c1-6d8417848586-registry-tls\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:08:55.651030 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:55.650985    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:08:55.740207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:55.740167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:55.740374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:55.740248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:08:55.740608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:55.740595    2578 scope.go:117] "RemoveContainer" containerID="4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8"
Jul 21 04:08:55.740777 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:08:55.740758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:08:55.778349 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:55.778315    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8ad917-c4e3-43fc-93c1-6d8417848586" path="/var/lib/kubelet/pods/0b8ad917-c4e3-43fc-93c1-6d8417848586/volumes"
Jul 21 04:08:57.219387 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.219352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:08:57.221676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.221656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0776a76e-e7c5-473d-8c8c-d71acc6df211-metrics-tls\") pod \"dns-default-czk4f\" (UID: \"0776a76e-e7c5-473d-8c8c-d71acc6df211\") " pod="openshift-dns/dns-default-czk4f"
Jul 21 04:08:57.247234 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.247185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:08:57.255117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.255092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:08:57.383536 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.383496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czk4f"]
Jul 21 04:08:57.387379 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:08:57.387351    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0776a76e_e7c5_473d_8c8c_d71acc6df211.slice/crio-76b59c6c0d001e0391158b478e8de30cd51cd02950579c28425b8453df4c6c13 WatchSource:0}: Error finding container 76b59c6c0d001e0391158b478e8de30cd51cd02950579c28425b8453df4c6c13: Status 404 returned error can't find the container with id 76b59c6c0d001e0391158b478e8de30cd51cd02950579c28425b8453df4c6c13
Jul 21 04:08:57.658318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:57.658280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czk4f" event={"ID":"0776a76e-e7c5-473d-8c8c-d71acc6df211","Type":"ContainerStarted","Data":"76b59c6c0d001e0391158b478e8de30cd51cd02950579c28425b8453df4c6c13"}
Jul 21 04:08:58.661136 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:58.661085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:58.762666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:58.762579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:08:59.667092 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:59.667061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czk4f" event={"ID":"0776a76e-e7c5-473d-8c8c-d71acc6df211","Type":"ContainerStarted","Data":"defa5ee28051f249ef73549d8a6840f520da5ac10f7cc781a016ccc0ac1c8ef2"}
Jul 21 04:08:59.667462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:59.667107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czk4f" event={"ID":"0776a76e-e7c5-473d-8c8c-d71acc6df211","Type":"ContainerStarted","Data":"58661b3c19f301f3607a3d16313d1fb5d5cd84d472e589368677d88a7e3c5691"}
Jul 21 04:08:59.667462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:59.667143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:08:59.685432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:08:59.685388    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-czk4f" podStartSLOduration=251.044075221 podStartE2EDuration="4m12.685372408s" totalImagesPullingTime="1.641297187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:59.684488289 +0000 UTC m=+288.434538787" watchObservedRunningTime="2026-07-21 04:08:59.685372408 +0000 UTC m=+288.435422947"
Jul 21 04:09:00.820094 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:00.820058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:00.928950 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:00.928914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:01.036078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.036038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:01.069820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.069791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"]
Jul 21 04:09:01.073061 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.073020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:01.075382 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.075364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 04:09:01.075507 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.075488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dz84x\""
Jul 21 04:09:01.085415 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.085392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"]
Jul 21 04:09:01.150827 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.150799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-p7zt7\" (UID: \"3e756c27-0589-4e8e-90bf-043858d354ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:01.251868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.251833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-p7zt7\" (UID: \"3e756c27-0589-4e8e-90bf-043858d354ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:01.252026 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:01.251948    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 04:09:01.252026 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:01.252008    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates podName:3e756c27-0589-4e8e-90bf-043858d354ea nodeName:}" failed. No retries permitted until 2026-07-21 04:09:01.751993716 +0000 UTC m=+290.502044190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-p7zt7" (UID: "3e756c27-0589-4e8e-90bf-043858d354ea") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 04:09:01.533872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.533831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:01.755303 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.755278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-p7zt7\" (UID: \"3e756c27-0589-4e8e-90bf-043858d354ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:01.757783 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.757753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e756c27-0589-4e8e-90bf-043858d354ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-p7zt7\" (UID: \"3e756c27-0589-4e8e-90bf-043858d354ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:01.981858 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:01.981823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:02.106676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:02.106647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"]
Jul 21 04:09:02.109452 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:02.109418    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e756c27_0589_4e8e_90bf_043858d354ea.slice/crio-9c17fcdd0d52f73cfe1637ddf93001d79254f6ac55cd3cf5b5fce589938c430d WatchSource:0}: Error finding container 9c17fcdd0d52f73cfe1637ddf93001d79254f6ac55cd3cf5b5fce589938c430d: Status 404 returned error can't find the container with id 9c17fcdd0d52f73cfe1637ddf93001d79254f6ac55cd3cf5b5fce589938c430d
Jul 21 04:09:02.676809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:02.676766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7" event={"ID":"3e756c27-0589-4e8e-90bf-043858d354ea","Type":"ContainerStarted","Data":"9c17fcdd0d52f73cfe1637ddf93001d79254f6ac55cd3cf5b5fce589938c430d"}
Jul 21 04:09:03.368914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:03.368876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:09:03.371657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:03.371633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92f67ec0-5e04-48f0-8253-d483456ffa07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhw48\" (UID: \"92f67ec0-5e04-48f0-8253-d483456ffa07\") " pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:09:03.632652 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:03.632624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zhw48"
Jul 21 04:09:03.779108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:03.779084    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zhw48"]
Jul 21 04:09:03.780607 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:03.780578    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f67ec0_5e04_48f0_8253_d483456ffa07.slice/crio-3c4313c73012c6ac564020f55ec670b501ea90a7c6090e22efa5e87b434d1f44 WatchSource:0}: Error finding container 3c4313c73012c6ac564020f55ec670b501ea90a7c6090e22efa5e87b434d1f44: Status 404 returned error can't find the container with id 3c4313c73012c6ac564020f55ec670b501ea90a7c6090e22efa5e87b434d1f44
Jul 21 04:09:04.686667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:04.686524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7" event={"ID":"3e756c27-0589-4e8e-90bf-043858d354ea","Type":"ContainerStarted","Data":"f6519b94646ea897d037aefa672fc3fb6d5aa855c41494feddc0b1c0d3fbead8"}
Jul 21 04:09:04.687184 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:04.686720    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:04.688043 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:04.688015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhw48" event={"ID":"92f67ec0-5e04-48f0-8253-d483456ffa07","Type":"ContainerStarted","Data":"3c4313c73012c6ac564020f55ec670b501ea90a7c6090e22efa5e87b434d1f44"}
Jul 21 04:09:04.692739 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:04.692712    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7"
Jul 21 04:09:04.703657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:04.703607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-p7zt7" podStartSLOduration=2.200347538 podStartE2EDuration="3.703592863s" totalImagesPullingTime="1.503245325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:04.70237433 +0000 UTC m=+293.452424828" watchObservedRunningTime="2026-07-21 04:09:04.703592863 +0000 UTC m=+293.453643361"
Jul 21 04:09:05.056983 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:05.056889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:05.129649 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:05.129613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:05.471890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:05.471844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:07.775533 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:07.775502    2578 scope.go:117] "RemoveContainer" containerID="4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8"
Jul 21 04:09:07.775968 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:07.775702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cl9p4_openshift-console-operator(83346093-da8d-43e4-82e1-af27fb1b0591)\"" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podUID="83346093-da8d-43e4-82e1-af27fb1b0591"
Jul 21 04:09:08.778613 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:08.778580    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t5d7v" podUID="14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34"
Jul 21 04:09:09.672316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:09.672284    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-czk4f"
Jul 21 04:09:09.708840 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:09.708798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhw48" event={"ID":"92f67ec0-5e04-48f0-8253-d483456ffa07","Type":"ContainerStarted","Data":"6b33da1aa9616fc3936c22c28eac0d06cf5a25d269d5633419fb5e2fbb345c57"}
Jul 21 04:09:10.442868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:10.442832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:11.525779 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:11.525744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:11.636946 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:11.636904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:11.729951 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:11.729789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:12.160372 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.160345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:09:12.160553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.160354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:09:12.167922 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.167903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:09:12.168065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.167908    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:09:12.170682 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.170660    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 04:09:12.722119 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:12.722082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhw48" event={"ID":"92f67ec0-5e04-48f0-8253-d483456ffa07","Type":"ContainerStarted","Data":"1cd3772b9f1a7166430eafb0c44e2867b68c0867fd100364eb783b11302e9da3"}
Jul 21 04:09:13.471053 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:13.471017    2578 patch_prober.go:28] interesting pod/image-registry-586645f5c4-5mp66 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 04:09:13.471278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:13.471076    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-586645f5c4-5mp66" podUID="5bc40118-71ce-4d00-9fd7-3d65fc53c5dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:09:14.227320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.227280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:14.496824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.496748    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hbcm5"]
Jul 21 04:09:14.502320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.502298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.504601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.504578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxcv9\""
Jul 21 04:09:14.504601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.504593    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 04:09:14.504758 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.504638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 04:09:14.505151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.505130    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 04:09:14.505278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.505179    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 04:09:14.505278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.505229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 04:09:14.505278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.505266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 04:09:14.560532 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-textfile\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-root\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbkl\" (UniqueName: \"kubernetes.io/projected/0357f445-8dd5-4db6-a783-7b2b0fcac74b-kube-api-access-tdbkl\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-wtmp\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-sys\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.560957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.560863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-metrics-client-ca\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-root\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662256 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbkl\" (UniqueName: \"kubernetes.io/projected/0357f445-8dd5-4db6-a783-7b2b0fcac74b-kube-api-access-tdbkl\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-wtmp\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-root\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-sys\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-metrics-client-ca\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-wtmp\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0357f445-8dd5-4db6-a783-7b2b0fcac74b-sys\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-textfile\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662982 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:14.662600    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 04:09:14.662982 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:09:14.662666    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls podName:0357f445-8dd5-4db6-a783-7b2b0fcac74b nodeName:}" failed. No retries permitted until 2026-07-21 04:09:15.16264492 +0000 UTC m=+303.912695395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls") pod "node-exporter-hbcm5" (UID: "0357f445-8dd5-4db6-a783-7b2b0fcac74b") : secret "node-exporter-tls" not found
Jul 21 04:09:14.662982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.662982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-textfile\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.663181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.662983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0357f445-8dd5-4db6-a783-7b2b0fcac74b-metrics-client-ca\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.665228 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.665196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:14.671037 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:14.671011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbkl\" (UniqueName: \"kubernetes.io/projected/0357f445-8dd5-4db6-a783-7b2b0fcac74b-kube-api-access-tdbkl\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:15.167820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:15.167782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:15.170553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:15.170525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0357f445-8dd5-4db6-a783-7b2b0fcac74b-node-exporter-tls\") pod \"node-exporter-hbcm5\" (UID: \"0357f445-8dd5-4db6-a783-7b2b0fcac74b\") " pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:15.416922 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:15.416884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbcm5"
Jul 21 04:09:15.873814 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:15.873728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:15.968879 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:15.968834    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0357f445_8dd5_4db6_a783_7b2b0fcac74b.slice/crio-7f37ffd2e5e71677d7cc17da773187cab136de91e49aaea609d1d28edb61e3f8 WatchSource:0}: Error finding container 7f37ffd2e5e71677d7cc17da773187cab136de91e49aaea609d1d28edb61e3f8: Status 404 returned error can't find the container with id 7f37ffd2e5e71677d7cc17da773187cab136de91e49aaea609d1d28edb61e3f8
Jul 21 04:09:15.970849 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:15.970829    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:09:16.659319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.659293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-586645f5c4-5mp66"
Jul 21 04:09:16.739533 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.739468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhw48" event={"ID":"92f67ec0-5e04-48f0-8253-d483456ffa07","Type":"ContainerStarted","Data":"349d159058c6bb65c6c73c69eacefd7a2885724f257d1fe7625647f154f3a64d"}
Jul 21 04:09:16.740931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.740897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbcm5" event={"ID":"0357f445-8dd5-4db6-a783-7b2b0fcac74b","Type":"ContainerStarted","Data":"7f37ffd2e5e71677d7cc17da773187cab136de91e49aaea609d1d28edb61e3f8"}
Jul 21 04:09:16.761787 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.761741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zhw48" podStartSLOduration=33.649580418 podStartE2EDuration="45.761722442s" totalImagesPullingTime="12.112142024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:08:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:16.7606286 +0000 UTC m=+305.510679122" watchObservedRunningTime="2026-07-21 04:09:16.761722442 +0000 UTC m=+305.511772939"
Jul 21 04:09:16.861642 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.861609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:16.963000 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:16.962962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:17.270025 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.269922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:17.371413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.371376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:17.466149 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.466111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:17.745983 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.745946    2578 generic.go:356] "Generic (PLEG): container finished" podID="0357f445-8dd5-4db6-a783-7b2b0fcac74b" containerID="a53c8207f5124665e1d740f159a74ae0857f75ad2b5ecb83d730c6d00e52b8ea" exitCode=0
Jul 21 04:09:17.746385 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.746040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbcm5" event={"ID":"0357f445-8dd5-4db6-a783-7b2b0fcac74b","Type":"ContainerDied","Data":"a53c8207f5124665e1d740f159a74ae0857f75ad2b5ecb83d730c6d00e52b8ea"}
Jul 21 04:09:17.813737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.813704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:17.919502 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:17.919468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:18.754995 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.754938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:18.756020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.755987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbcm5" event={"ID":"0357f445-8dd5-4db6-a783-7b2b0fcac74b","Type":"ContainerStarted","Data":"a6ec79698f3c28c64e57d7303db514fb38fbf1c76b828cb7316ae71fc96acd82"}
Jul 21 04:09:18.756156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.756057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbcm5" event={"ID":"0357f445-8dd5-4db6-a783-7b2b0fcac74b","Type":"ContainerStarted","Data":"5adb480ae7e0cec9411907b81018fd4a5a1d09d4b32ff4d23e59da3221e555cb"}
Jul 21 04:09:18.775154 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.775112    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hbcm5" podStartSLOduration=3.798720167 podStartE2EDuration="4.775099901s" totalImagesPullingTime="905.513001ms" totalInitContainerRuntime="70.866733ms" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:18.77424161 +0000 UTC m=+307.524292105" watchObservedRunningTime="2026-07-21 04:09:18.775099901 +0000 UTC m=+307.525150398"
Jul 21 04:09:18.852007 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.851981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:18.879915 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.879887    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-787d686c5f-msxpz"]
Jul 21 04:09:18.882937 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.882922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:18.885229 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885193    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 04:09:18.885381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 04:09:18.885462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 04:09:18.885528 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 04:09:18.885583 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9cmrm\""
Jul 21 04:09:18.885633 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.885589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5jgdm9cge1b1o\""
Jul 21 04:09:18.895545 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:18.895523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-787d686c5f-msxpz"]
Jul 21 04:09:19.000677 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cclc\" (UniqueName: \"kubernetes.io/projected/c69bffdf-05df-4824-9906-31fe3bdd19f8-kube-api-access-5cclc\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000677 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-client-certs\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-tls\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-metrics-server-audit-profiles\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c69bffdf-05df-4824-9906-31fe3bdd19f8-audit-log\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-client-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.000894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.000826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.101971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-client-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102233 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cclc\" (UniqueName: \"kubernetes.io/projected/c69bffdf-05df-4824-9906-31fe3bdd19f8-kube-api-access-5cclc\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102233 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-client-certs\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-tls\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-metrics-server-audit-profiles\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c69bffdf-05df-4824-9906-31fe3bdd19f8-audit-log\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c69bffdf-05df-4824-9906-31fe3bdd19f8-audit-log\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.102751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.102743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.103523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.103498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c69bffdf-05df-4824-9906-31fe3bdd19f8-metrics-server-audit-profiles\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.104663 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.104632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-client-ca-bundle\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.104817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.104800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-client-certs\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.104882 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.104815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c69bffdf-05df-4824-9906-31fe3bdd19f8-secret-metrics-server-tls\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.110848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.110825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cclc\" (UniqueName: \"kubernetes.io/projected/c69bffdf-05df-4824-9906-31fe3bdd19f8-kube-api-access-5cclc\") pod \"metrics-server-787d686c5f-msxpz\" (UID: \"c69bffdf-05df-4824-9906-31fe3bdd19f8\") " pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.192930 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.192890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:19.248001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.247972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"]
Jul 21 04:09:19.252587 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.252566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.255375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.254931    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 04:09:19.255375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.255198    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vtlk4\""
Jul 21 04:09:19.260796 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.260739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:19.263015 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.262960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"]
Jul 21 04:09:19.326394 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.326364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-787d686c5f-msxpz"]
Jul 21 04:09:19.329242 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:19.329198    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69bffdf_05df_4824_9906_31fe3bdd19f8.slice/crio-15d06f7cb5e7e0237ba6a1617ca2bb8e3f3a8d26fb634ccb8ea30c734ea67250 WatchSource:0}: Error finding container 15d06f7cb5e7e0237ba6a1617ca2bb8e3f3a8d26fb634ccb8ea30c734ea67250: Status 404 returned error can't find the container with id 15d06f7cb5e7e0237ba6a1617ca2bb8e3f3a8d26fb634ccb8ea30c734ea67250
Jul 21 04:09:19.404358 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.404285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhzck\" (UniqueName: \"kubernetes.io/projected/65d8ec7c-cc6e-465b-b858-53da49843b71-kube-api-access-nhzck\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.404358 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.404337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65d8ec7c-cc6e-465b-b858-53da49843b71-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.503029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.503001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:19.504967 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.504945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65d8ec7c-cc6e-465b-b858-53da49843b71-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.505068 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.505037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhzck\" (UniqueName: \"kubernetes.io/projected/65d8ec7c-cc6e-465b-b858-53da49843b71-kube-api-access-nhzck\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.507403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.507386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65d8ec7c-cc6e-465b-b858-53da49843b71-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.513634 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.513615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhzck\" (UniqueName: \"kubernetes.io/projected/65d8ec7c-cc6e-465b-b858-53da49843b71-kube-api-access-nhzck\") pod \"monitoring-plugin-7b7b7bc8bf-g7j9t\" (UID: \"65d8ec7c-cc6e-465b-b858-53da49843b71\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.567656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.567626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:19.691448 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.691417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"]
Jul 21 04:09:19.694846 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:19.694820    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d8ec7c_cc6e_465b_b858_53da49843b71.slice/crio-9025f0eeeeb7c2cbd2f2d1e6590eedabb056e0938214ae467358c8071b9e366d WatchSource:0}: Error finding container 9025f0eeeeb7c2cbd2f2d1e6590eedabb056e0938214ae467358c8071b9e366d: Status 404 returned error can't find the container with id 9025f0eeeeb7c2cbd2f2d1e6590eedabb056e0938214ae467358c8071b9e366d
Jul 21 04:09:19.760725 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.760689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t" event={"ID":"65d8ec7c-cc6e-465b-b858-53da49843b71","Type":"ContainerStarted","Data":"9025f0eeeeb7c2cbd2f2d1e6590eedabb056e0938214ae467358c8071b9e366d"}
Jul 21 04:09:19.761817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:19.761784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz" event={"ID":"c69bffdf-05df-4824-9906-31fe3bdd19f8","Type":"ContainerStarted","Data":"15d06f7cb5e7e0237ba6a1617ca2bb8e3f3a8d26fb634ccb8ea30c734ea67250"}
Jul 21 04:09:20.699130 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.699090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:20.703752 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.703725    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:09:20.707643 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.707620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.710196 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.710170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 04:09:20.710343 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.710282    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 04:09:20.710568 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.710515    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 04:09:20.711261 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 04:09:20.711261 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 04:09:20.711424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 04:09:20.711424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711400    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 04:09:20.711424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 04:09:20.711548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711500    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 04:09:20.711548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711522    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 04:09:20.711618 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711579    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5rqgp\""
Jul 21 04:09:20.711656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.711630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-87864q6qi2jvr\""
Jul 21 04:09:20.712104 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.712082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 04:09:20.715453 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.715294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 04:09:20.716108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.715946    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 04:09:20.718738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.718716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 04:09:20.726848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.726828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:09:20.816431 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816431 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8nd\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.816912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.816983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.817281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.817134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918266 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918266 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.918831 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.918929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919173 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8nd\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919363 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.919603 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.920524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.919832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.921744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.921182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.922939 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.922466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.924560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.924534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.925665 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.924651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.925665 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.925481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.925665 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.925605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.926313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.926272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.926313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.926303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.926634 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.926619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.927153 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.927129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.927327 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.927138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.927721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.927700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.927797 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.927729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.928708 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.928684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:20.935532 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:20.935491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8nd\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd\") pod \"prometheus-k8s-0\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:21.020203 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.020119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:21.182943 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.182905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:09:21.429298 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:09:21.429266    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e9bc2b_52e4_414f_874a_ad0a1942782f.slice/crio-f2b59335ec6c020a9b76e16f16c87f66a836b044dff49e4dae2c7ce471cebbe8 WatchSource:0}: Error finding container f2b59335ec6c020a9b76e16f16c87f66a836b044dff49e4dae2c7ce471cebbe8: Status 404 returned error can't find the container with id f2b59335ec6c020a9b76e16f16c87f66a836b044dff49e4dae2c7ce471cebbe8
Jul 21 04:09:21.769583 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.769487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t" event={"ID":"65d8ec7c-cc6e-465b-b858-53da49843b71","Type":"ContainerStarted","Data":"c8a2a83e63cef3638cc3c21fcadd8d9a8fefcefb0e4a7dac8d33fb74f0900fed"}
Jul 21 04:09:21.769734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.769646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:21.771017 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.770983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz" event={"ID":"c69bffdf-05df-4824-9906-31fe3bdd19f8","Type":"ContainerStarted","Data":"b834ffcfe43f18efa3e10c333b41db88d34ee54b4708d57583df00d3f3768e99"}
Jul 21 04:09:21.772149 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.772125    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"f2b59335ec6c020a9b76e16f16c87f66a836b044dff49e4dae2c7ce471cebbe8"}
Jul 21 04:09:21.778712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.778690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t"
Jul 21 04:09:21.788705 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.788655    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g7j9t" podStartSLOduration=1.011708748 podStartE2EDuration="2.788638124s" totalImagesPullingTime="1.776929376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:21.787547601 +0000 UTC m=+310.537598112" watchObservedRunningTime="2026-07-21 04:09:21.788638124 +0000 UTC m=+310.538688622"
Jul 21 04:09:21.820957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:21.820909    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz" podStartSLOduration=2.129914512 podStartE2EDuration="3.820896094s" totalImagesPullingTime="1.690981582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:21.820262988 +0000 UTC m=+310.570313485" watchObservedRunningTime="2026-07-21 04:09:21.820896094 +0000 UTC m=+310.570946591"
Jul 21 04:09:22.775025 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:22.774996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:09:22.775195 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:22.775130    2578 scope.go:117] "RemoveContainer" containerID="4dafb4eef0f1db5baeb8b86ab51b165c9cf28b7b3ae3843b887a2b71a7908fc8"
Jul 21 04:09:22.777138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:22.777110    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2" exitCode=0
Jul 21 04:09:22.777388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:22.777188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"}
Jul 21 04:09:23.786162 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.786133    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:09:23.786618 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.786245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" event={"ID":"83346093-da8d-43e4-82e1-af27fb1b0591","Type":"ContainerStarted","Data":"7534c46412ba01419a064246558d5e8d8972b2586244acf0fbfd4ad4d4ae1296"}
Jul 21 04:09:23.786701 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.786666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:09:23.792533 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.792504    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4"
Jul 21 04:09:23.804954 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.804901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-cl9p4" podStartSLOduration=56.503245228 podStartE2EDuration="58.804886517s" totalImagesPullingTime="2.301641289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:23.804126385 +0000 UTC m=+312.554176882" watchObservedRunningTime="2026-07-21 04:09:23.804886517 +0000 UTC m=+312.554937016"
Jul 21 04:09:23.933533 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:23.933493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:24.028784 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:24.028745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:24.129381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:24.129310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:24.414170 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:24.414118    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:24.594611 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:24.594570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:24.654260 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:24.654196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:25.005609 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:25.005573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:25.072121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:25.072075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:25.816326 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:25.816288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:26.013847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.013802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:26.114413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.114323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:26.800876 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.800843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"}
Jul 21 04:09:26.801039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.800904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"}
Jul 21 04:09:26.832738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.832695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:26.934117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:26.934039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:27.319791 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:27.319732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:27.376842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:27.376805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:27.876493 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:27.876447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:27.973711 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:27.973678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:28.810672 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:28.810635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"}
Jul 21 04:09:28.811042 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:28.810704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"}
Jul 21 04:09:28.811042 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:28.810740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"}
Jul 21 04:09:28.811042 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:28.810770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerStarted","Data":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"}
Jul 21 04:09:28.843612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:28.843559    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.693778345 podStartE2EDuration="8.843542494s" totalImagesPullingTime="6.132319064s" totalInitContainerRuntime="17.445085ms" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:28.84199909 +0000 UTC m=+317.592049588" watchObservedRunningTime="2026-07-21 04:09:28.843542494 +0000 UTC m=+317.593592991"
Jul 21 04:09:29.150274 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:29.150190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:29.219743 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:29.219706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:31.020591 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:31.020562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:09:34.419041 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:34.419004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:34.483358 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:34.483328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:35.428413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:35.428377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:35.481575 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:35.481541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:36.442925 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:36.442891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:36.543865 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:36.543828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:37.710156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:37.710115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:37.811130 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:37.811099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:37.872510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:37.872481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:39.193785 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:39.193741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:39.194160 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:39.193813    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:39.424678 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:39.424635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:39.524980 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:39.524894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:43.241086 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:43.241046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:49.437765 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:49.437722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:49.496774 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:49.496741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:50.430171 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:50.430128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:50.530812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:50.530773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:51.850396 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:51.850360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:51.915792 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:51.915760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:57.812664 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:57.812627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:09:59.198720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:59.198690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:09:59.202577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:09:59.202557    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-787d686c5f-msxpz"
Jul 21 04:10:04.428757 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:04.428673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:04.528839 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:04.528803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:21.020321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:21.020287    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:21.039338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:21.039313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:22.013783 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:22.013756    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:25.046198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.046159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:25.103952 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.103915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:25.676174 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.676131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:10:25.678560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.678530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34-metrics-certs\") pod \"network-metrics-daemon-t5d7v\" (UID: \"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34\") " pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:10:25.778251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.778227    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:10:25.786076 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.786057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5d7v"
Jul 21 04:10:25.912366 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:25.912335    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5d7v"]
Jul 21 04:10:25.915620 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:10:25.915589    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f1fb38_02a2_4cbc_b2e7_3d5013ecdc34.slice/crio-2165891153a0ef171e94fe7b4813a0184a0c7157ea923eb7001459385e019b36 WatchSource:0}: Error finding container 2165891153a0ef171e94fe7b4813a0184a0c7157ea923eb7001459385e019b36: Status 404 returned error can't find the container with id 2165891153a0ef171e94fe7b4813a0184a0c7157ea923eb7001459385e019b36
Jul 21 04:10:26.013877 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:26.013803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5d7v" event={"ID":"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34","Type":"ContainerStarted","Data":"2165891153a0ef171e94fe7b4813a0184a0c7157ea923eb7001459385e019b36"}
Jul 21 04:10:27.018838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:27.018805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5d7v" event={"ID":"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34","Type":"ContainerStarted","Data":"bba2defe7a3be4b7c4a136e96b11a1935ba3d8183ffc5f3a612dacf3481f54b0"}
Jul 21 04:10:27.019163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:27.018860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5d7v" event={"ID":"14f1fb38-02a2-4cbc-b2e7-3d5013ecdc34","Type":"ContainerStarted","Data":"891aaf7ef488d0b2a4c31afdf1dd95925af38df23fdd34d5cf0716bd9096d628"}
Jul 21 04:10:27.036872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:27.036762    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t5d7v" podStartSLOduration=374.141845653 podStartE2EDuration="6m15.036743397s" totalImagesPullingTime="894.897744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:27.035406743 +0000 UTC m=+375.785457241" watchObservedRunningTime="2026-07-21 04:10:27.036743397 +0000 UTC m=+375.786793895"
Jul 21 04:10:27.126586 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:27.126492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:27.183745 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:27.183710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:33.726441 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:33.726407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:34.024200 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:34.024121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:39.102406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102369    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102648    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="prometheus" containerID="cri-o://29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11" gracePeriod=600
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102677    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy" containerID="cri-o://be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6" gracePeriod=600
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102714    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="thanos-sidecar" containerID="cri-o://f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1" gracePeriod=600
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102739    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-web" containerID="cri-o://41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21" gracePeriod=600
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102736    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e" gracePeriod=600
Jul 21 04:10:39.102810 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.102754    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="config-reloader" containerID="cri-o://ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb" gracePeriod=600
Jul 21 04:10:39.332183 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.332158    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:39.382630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382603    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv8nd\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382710    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.382842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382751    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.383089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.382876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.383142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.383104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.383229 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.383150    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.383947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.383571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.384629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.384629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384473    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.384629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.384890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384953    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.384982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385032    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db\") pod \"33e9bc2b-52e4-414f-874a-ad0a1942782f\" (UID: \"33e9bc2b-52e4-414f-874a-ad0a1942782f\") "
Jul 21 04:10:39.385589 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385561    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-metrics-client-ca\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.385589 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385581    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.385694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.385694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd" (OuterVolumeSpecName: "kube-api-access-nv8nd") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "kube-api-access-nv8nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:39.385694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.385645    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out" (OuterVolumeSpecName: "config-out") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:10:39.386635 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.386034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.386635 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.386105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.386635 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.386116    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.386635 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.386424    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:39.386895 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.386872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:10:39.388390 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.388353    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.388488 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.388396    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.388488 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.388431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.388609 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.388509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config" (OuterVolumeSpecName: "config") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.389491 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.389471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.389601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.389583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:39.399771 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.399748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config" (OuterVolumeSpecName: "web-config") pod "33e9bc2b-52e4-414f-874a-ad0a1942782f" (UID: "33e9bc2b-52e4-414f-874a-ad0a1942782f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:39.485924 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485876    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.485924 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485910    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-db\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.485924 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485919    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-grpc-tls\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.485924 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485927    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv8nd\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-kube-api-access-nv8nd\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.485924 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485936    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485946    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485956    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485965    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33e9bc2b-52e4-414f-874a-ad0a1942782f-config-out\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485972    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485981    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485989    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.485998    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486007    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-web-config\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486014    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33e9bc2b-52e4-414f-874a-ad0a1942782f-tls-assets\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486021    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-kube-rbac-proxy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486028    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33e9bc2b-52e4-414f-874a-ad0a1942782f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486037    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-config\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:39.486205 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:39.486045    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33e9bc2b-52e4-414f-874a-ad0a1942782f-secret-metrics-client-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069431    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069457    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069463    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069469    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069477    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069487    2578 generic.go:356] "Generic (PLEG): container finished" podID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11" exitCode=0
Jul 21 04:10:40.069521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069505    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069704    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"}
Jul 21 04:10:40.069872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.069765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33e9bc2b-52e4-414f-874a-ad0a1942782f","Type":"ContainerDied","Data":"f2b59335ec6c020a9b76e16f16c87f66a836b044dff49e4dae2c7ce471cebbe8"}
Jul 21 04:10:40.077411 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.077397    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.084262 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.084241    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.091324 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.091300    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:40.091507 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.091492    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.095286 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.095264    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:40.098515 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.098500    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.105050 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.104891    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.112150 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.112130    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.121299 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121274    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:40.121570 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121541    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-web"
Jul 21 04:10:40.121570 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121560    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-web"
Jul 21 04:10:40.121570 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121573    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-thanos"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121579    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-thanos"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121593    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="prometheus"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121599    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="prometheus"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121605    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="config-reloader"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121610    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="config-reloader"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121618    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="init-config-reloader"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121622    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="init-config-reloader"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121629    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="thanos-sidecar"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="thanos-sidecar"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121641    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121646    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy"
Jul 21 04:10:40.121691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121692    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-thanos"
Jul 21 04:10:40.122108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121700    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="thanos-sidecar"
Jul 21 04:10:40.122108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121707    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="config-reloader"
Jul 21 04:10:40.122108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121714    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy-web"
Jul 21 04:10:40.122108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121719    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="kube-rbac-proxy"
Jul 21 04:10:40.122108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.121726    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" containerName="prometheus"
Jul 21 04:10:40.127270 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.127239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.130461 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130439    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 04:10:40.130602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 04:10:40.130779 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 04:10:40.130779 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 04:10:40.130911 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 04:10:40.130911 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 04:10:40.131010 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.130955    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 04:10:40.131392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-87864q6qi2jvr\""
Jul 21 04:10:40.131498 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131470    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 04:10:40.131498 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131487    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 04:10:40.131722 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5rqgp\""
Jul 21 04:10:40.131811 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 04:10:40.132018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.131996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 04:10:40.132202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.132184    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 04:10:40.133160 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.133147    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.133573 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.133551    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.133658 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.133584    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.133658 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.133625    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.133987 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.133946    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.134137 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.133983    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.134137 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134007    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.134496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134180    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 04:10:40.134496 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.134276    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.134496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134304    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.134496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134326    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.134769 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.134617    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.134769 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134641    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.134769 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.134660    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.135011 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.134989    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.135111 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135086    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.135190 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135113    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.135438 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.135419    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.135497 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.135497 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135458    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.135742 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:10:40.135723    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.135828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135750    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.135828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.135771    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.136078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136053    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.136078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136078    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.136517 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136485    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.136611 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136519    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.136764 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136743    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 04:10:40.136824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136765    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.136824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.136786    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.137093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137071    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.137169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137095    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.137383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137365    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.137428 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137385    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.137608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137593    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.137651 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137608    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.137828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137810    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.137867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.137830    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.138052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138034    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.138115 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138054    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.138320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138297    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.138400 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138320    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.138546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138529    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.138584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138548    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.138736 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138720    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.138780 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138736    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.138933 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138915    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.138968 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.138934    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.139114 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139099    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.139153 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139114    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.139397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139381    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.139449 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139397    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.139599 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139582    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.139599 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139597    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.139809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139793    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.139855 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139809    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.139991 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139976    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.140030 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.139992    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.140165 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140141    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.140200 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140166    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.140386 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140371    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.140386 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140385    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.140597 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140565    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.140597 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140589    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.140812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140797    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.140865 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.140812    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.141019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141004    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.141019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141018    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.141225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141197    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.141265 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141228    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.141421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141405    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.141421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141420    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.141599 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141580    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.141599 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141598    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.141772 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141757    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.141812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141772    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.141971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141952    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.141971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.141970    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.142153 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.142153 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142152    2578 scope.go:117] "RemoveContainer" containerID="e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"
Jul 21 04:10:40.142343 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142330    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e"} err="failed to get container status \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": rpc error: code = NotFound desc = could not find container \"e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e\": container with ID starting with e1fff8fd94ec6964c70305f97144961c3b8025ffbc83bc6a86caf060bf8a920e not found: ID does not exist"
Jul 21 04:10:40.142388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142342    2578 scope.go:117] "RemoveContainer" containerID="be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"
Jul 21 04:10:40.142529 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142514    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6"} err="failed to get container status \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": rpc error: code = NotFound desc = could not find container \"be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6\": container with ID starting with be9137d1c49284c5d297688fcfe88068b8ce73123ac8d3160c28135b9677aed6 not found: ID does not exist"
Jul 21 04:10:40.142571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142529    2578 scope.go:117] "RemoveContainer" containerID="41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"
Jul 21 04:10:40.142709 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142695    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21"} err="failed to get container status \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": rpc error: code = NotFound desc = could not find container \"41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21\": container with ID starting with 41840c0178fa505df9e82f10372103e6c3471f000fceeb30050a7f397b197e21 not found: ID does not exist"
Jul 21 04:10:40.142709 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142709    2578 scope.go:117] "RemoveContainer" containerID="f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"
Jul 21 04:10:40.142893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142878    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1"} err="failed to get container status \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": rpc error: code = NotFound desc = could not find container \"f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1\": container with ID starting with f8ed34839ae66c1547f280b9c3f6bbb1909f47c849f53729919532796b0891e1 not found: ID does not exist"
Jul 21 04:10:40.142893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.142892    2578 scope.go:117] "RemoveContainer" containerID="ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"
Jul 21 04:10:40.143070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.143056    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb"} err="failed to get container status \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": rpc error: code = NotFound desc = could not find container \"ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb\": container with ID starting with ea02cc054ed41cf8f42bd1838f0c8a60d7810ace66097edefdcaea548b4ac2bb not found: ID does not exist"
Jul 21 04:10:40.143070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.143070    2578 scope.go:117] "RemoveContainer" containerID="29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"
Jul 21 04:10:40.143271 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.143252    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11"} err="failed to get container status \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": rpc error: code = NotFound desc = could not find container \"29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11\": container with ID starting with 29c7b37c0a5500fb82c1740a1516ec2b2f29dbf248bf02cff1dab1c3da8e9e11 not found: ID does not exist"
Jul 21 04:10:40.143314 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.143271    2578 scope.go:117] "RemoveContainer" containerID="0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"
Jul 21 04:10:40.143477 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.143462    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2"} err="failed to get container status \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": rpc error: code = NotFound desc = could not find container \"0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2\": container with ID starting with 0aa7a9340ed3301c60bee573f91cc8a0fae0666f849b9d5f8d4f463565406af2 not found: ID does not exist"
Jul 21 04:10:40.146397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.146377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:40.192923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.192887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.192923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.192926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.192923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.192943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.192958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-web-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-config-out\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjx2\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-kube-api-access-sjjx2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.193524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.193507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294447 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjx2\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-kube-api-access-sjjx2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-web-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-config-out\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.294869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.295432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.294974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.295432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.295031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.295551 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.295529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.295765 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.295744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.296909 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.296572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.297715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.297395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1623fbc4-23e2-4888-939e-db50c5d14928-config-out\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.297715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.297624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.298011 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.297962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.298505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.298436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.298505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.298516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.299071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.299050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1623fbc4-23e2-4888-939e-db50c5d14928-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.299327 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.299263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.299550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.299527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.299873 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.299854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.300309 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.300288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.300656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.300633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.300753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.300736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-web-config\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.301078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.301059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1623fbc4-23e2-4888-939e-db50c5d14928-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.309232 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.309185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjx2\" (UniqueName: \"kubernetes.io/projected/1623fbc4-23e2-4888-939e-db50c5d14928-kube-api-access-sjjx2\") pod \"prometheus-k8s-0\" (UID: \"1623fbc4-23e2-4888-939e-db50c5d14928\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.439646 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.439610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:40.580845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:40.580767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 04:10:40.583010 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:10:40.582977    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1623fbc4_23e2_4888_939e_db50c5d14928.slice/crio-95479d6d15f2ba21fe4094eaae20317b99b8c2b2a38baf57b057b9f8af0425a8 WatchSource:0}: Error finding container 95479d6d15f2ba21fe4094eaae20317b99b8c2b2a38baf57b057b9f8af0425a8: Status 404 returned error can't find the container with id 95479d6d15f2ba21fe4094eaae20317b99b8c2b2a38baf57b057b9f8af0425a8
Jul 21 04:10:41.074975 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:41.074940    2578 generic.go:356] "Generic (PLEG): container finished" podID="1623fbc4-23e2-4888-939e-db50c5d14928" containerID="cb369b5f9578563f262244f95e8f519492618e6f743e59b47960282cf8a5ffb7" exitCode=0
Jul 21 04:10:41.075169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:41.074995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerDied","Data":"cb369b5f9578563f262244f95e8f519492618e6f743e59b47960282cf8a5ffb7"}
Jul 21 04:10:41.075169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:41.075043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"95479d6d15f2ba21fe4094eaae20317b99b8c2b2a38baf57b057b9f8af0425a8"}
Jul 21 04:10:41.780987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:41.780957    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e9bc2b-52e4-414f-874a-ad0a1942782f" path="/var/lib/kubelet/pods/33e9bc2b-52e4-414f-874a-ad0a1942782f/volumes"
Jul 21 04:10:42.082180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"9b6398e1e5825f32d24698f24a9abb8b13beaa2f031ed8852e3a4ad72862d273"}
Jul 21 04:10:42.082180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"1896f42ad078a4267ee826f6dfdc7dc50fe3ba8574c6dba6800784481e404ff7"}
Jul 21 04:10:42.082180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"a5b8c7b0ca1117c57ad0f81ae810c87325a84ba678a57b73a0c001283797330d"}
Jul 21 04:10:42.082459 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"08f14a80adfddf1169093ea895af1d14b6800d8a5e01ffa802a5376b19591e18"}
Jul 21 04:10:42.082459 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"c2bd3cf99f64716a24f42dcee90796f6ac63fe5a5ad910b66e4989586b0d8848"}
Jul 21 04:10:42.082459 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.082267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1623fbc4-23e2-4888-939e-db50c5d14928","Type":"ContainerStarted","Data":"3ef197b545b7ebfea3c9efa50fdf6bd588ac54e861dccba721030b9356d53d89"}
Jul 21 04:10:42.111374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.111331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.092758743 podStartE2EDuration="2.111296096s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.537353ms" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:42.109882974 +0000 UTC m=+390.859933516" watchObservedRunningTime="2026-07-21 04:10:42.111296096 +0000 UTC m=+390.861346593"
Jul 21 04:10:42.787912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.787856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:42.887184 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.887153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:42.987321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:42.987294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:43.536575 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:43.536534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:43.638051 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:43.638014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:45.439806 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:45.439758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:10:47.063603 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:47.063564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:47.125876 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:47.125839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:53.288548 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:53.288507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:10:53.387968 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:10:53.387931    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:11:35.910274 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:35.910162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:11:40.439929 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:40.439891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:11:40.455977 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:40.455950    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:11:41.312571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:41.312540    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 04:11:48.972065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:48.972024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:11:49.026098 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:11:49.026046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:00.942125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:00.942075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:01.009644 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:01.009597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:04.466891 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:04.466847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:04.560571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:04.560534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:04.794491 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:04.794393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:13.728049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:13.728008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:13.787099 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:13.787061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:24.624915 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:24.624879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:24.726144 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:24.726103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:24.826164 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:24.826127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:24.927389 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:24.927361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:36.767865 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:36.767825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:12:36.864643 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:12:36.864598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:03.623593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:03.623495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:03.751177 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:03.751139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:05.146754 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:05.146712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:07.375176 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:07.375137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:07.479118 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:07.479085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:09.076100 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:09.076052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:09.188623 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:09.188591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:09.293926 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:09.293893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:09.431403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:09.431362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:11.650304 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:11.650266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:11.859904 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:11.859865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:14.408537 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:14.408496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:14.525158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:14.525121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:17.047463 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:17.047425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:17.115128 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:17.115086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:19.254744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:19.254710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:25.769378 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:25.769334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:25.867184 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:25.867149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:27.792805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.792765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"]
Jul 21 04:13:27.796020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.796002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.798426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.798400    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:13:27.798536 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.798454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 04:13:27.799091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.799074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-56477\""
Jul 21 04:13:27.805964 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.805936    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"]
Jul 21 04:13:27.880467 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.880422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bsls\" (UniqueName: \"kubernetes.io/projected/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-kube-api-access-9bsls\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.880646 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.880480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.981148 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.981114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bsls\" (UniqueName: \"kubernetes.io/projected/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-kube-api-access-9bsls\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.981304 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.981162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.981516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.981500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:27.989394 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:27.989375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bsls\" (UniqueName: \"kubernetes.io/projected/887e5ce2-54c2-40e9-bdf6-60925f0ba0de-kube-api-access-9bsls\") pod \"openshift-lws-operator-fd8ccff4c-fq6hz\" (UID: \"887e5ce2-54c2-40e9-bdf6-60925f0ba0de\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:28.117824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:28.117723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"
Jul 21 04:13:28.251777 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:28.251749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz"]
Jul 21 04:13:28.254333 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:13:28.254304    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod887e5ce2_54c2_40e9_bdf6_60925f0ba0de.slice/crio-3acb616541d80c6666568b01d2f483df88217fe7732bf096a3d8e8d29fbcedbe WatchSource:0}: Error finding container 3acb616541d80c6666568b01d2f483df88217fe7732bf096a3d8e8d29fbcedbe: Status 404 returned error can't find the container with id 3acb616541d80c6666568b01d2f483df88217fe7732bf096a3d8e8d29fbcedbe
Jul 21 04:13:28.693791 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:28.693754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz" event={"ID":"887e5ce2-54c2-40e9-bdf6-60925f0ba0de","Type":"ContainerStarted","Data":"3acb616541d80c6666568b01d2f483df88217fe7732bf096a3d8e8d29fbcedbe"}
Jul 21 04:13:31.708485 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:31.708443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz" event={"ID":"887e5ce2-54c2-40e9-bdf6-60925f0ba0de","Type":"ContainerStarted","Data":"cbdd32dc3060317c2b458ce69e604dbda3b37e062d6862c26f98d29ccc2761db"}
Jul 21 04:13:31.728383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:31.728327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fq6hz" podStartSLOduration=2.165457729 podStartE2EDuration="4.728311547s" totalImagesPullingTime="2.562853818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:31.726352902 +0000 UTC m=+560.476403400" watchObservedRunningTime="2026-07-21 04:13:31.728311547 +0000 UTC m=+560.478362043"
Jul 21 04:13:32.473815 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:32.473777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:32.574199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:32.574161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:34.498018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:34.497970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:44.820043 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:44.820002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:44.923004 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:44.922956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:47.186089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:47.186047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:47.284967 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:47.284930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:47.792897 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:47.792858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.003445 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.003408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.106768 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.106671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.157437 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.157401    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"]
Jul 21 04:13:48.160841 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.160822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.168259 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.168233    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 04:13:48.168399 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.168344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 04:13:48.168399 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.168386    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 04:13:48.168513 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.168386    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k7b2b\""
Jul 21 04:13:48.168513 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.168390    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 04:13:48.189196 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.189158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"]
Jul 21 04:13:48.253951 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.253910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.253951 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.253957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.254181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.254023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z4mb\" (UniqueName: \"kubernetes.io/projected/8234071d-b6ad-4236-9686-62fc338ea408-kube-api-access-4z4mb\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.254181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.254125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.254181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.254151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.354967 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.354924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.355125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.354976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.355125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.355035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z4mb\" (UniqueName: \"kubernetes.io/projected/8234071d-b6ad-4236-9686-62fc338ea408-kube-api-access-4z4mb\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.355125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.355076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.355125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.355108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.355513 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.355491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.357631 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.357570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8234071d-b6ad-4236-9686-62fc338ea408-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.357727 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.357656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.357764 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.357746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8234071d-b6ad-4236-9686-62fc338ea408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.366617 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.366589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z4mb\" (UniqueName: \"kubernetes.io/projected/8234071d-b6ad-4236-9686-62fc338ea408-kube-api-access-4z4mb\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-vvrmt\" (UID: \"8234071d-b6ad-4236-9686-62fc338ea408\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.368008 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.367978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.466786 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.466745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.471605 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.471580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:48.569047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.568997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.626124 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.626039    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"]
Jul 21 04:13:48.630589 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:13:48.630562    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8234071d_b6ad_4236_9686_62fc338ea408.slice/crio-a2454f28f66dd1560587c1db825b432ca05a51ad184ef00959fa39fe33af42ef WatchSource:0}: Error finding container a2454f28f66dd1560587c1db825b432ca05a51ad184ef00959fa39fe33af42ef: Status 404 returned error can't find the container with id a2454f28f66dd1560587c1db825b432ca05a51ad184ef00959fa39fe33af42ef
Jul 21 04:13:48.642072 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.642042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.706329 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.706280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.776765 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.776725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt" event={"ID":"8234071d-b6ad-4236-9686-62fc338ea408","Type":"ContainerStarted","Data":"a2454f28f66dd1560587c1db825b432ca05a51ad184ef00959fa39fe33af42ef"}
Jul 21 04:13:48.807117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.807056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:48.908912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:48.908852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:13:51.792579 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:51.792544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt" event={"ID":"8234071d-b6ad-4236-9686-62fc338ea408","Type":"ContainerStarted","Data":"8275e3a9afdd0c136c4cb87341e4496931cabab9ab03d45ce37796eee780c62f"}
Jul 21 04:13:52.798204 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:52.798168    2578 generic.go:356] "Generic (PLEG): container finished" podID="8234071d-b6ad-4236-9686-62fc338ea408" containerID="8275e3a9afdd0c136c4cb87341e4496931cabab9ab03d45ce37796eee780c62f" exitCode=0
Jul 21 04:13:52.798630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:52.798262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt" event={"ID":"8234071d-b6ad-4236-9686-62fc338ea408","Type":"ContainerDied","Data":"8275e3a9afdd0c136c4cb87341e4496931cabab9ab03d45ce37796eee780c62f"}
Jul 21 04:13:53.805710 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:53.805673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt" event={"ID":"8234071d-b6ad-4236-9686-62fc338ea408","Type":"ContainerStarted","Data":"3a1c7e1eba45be0d15d35facfeebf2bb15452165fe34ef7a1cfa782f807a048a"}
Jul 21 04:13:53.806155 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:53.805792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:13:53.827553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:53.827495    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt" podStartSLOduration=1.40913983 podStartE2EDuration="5.827475881s" totalImagesPullingTime="3.384998386s" totalInitContainerRuntime="1.033337665s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:53.825351102 +0000 UTC m=+582.575401600" watchObservedRunningTime="2026-07-21 04:13:53.827475881 +0000 UTC m=+582.577526377"
Jul 21 04:13:59.935836 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:13:59.935796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:00.040781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:00.040726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:04.812450 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:04.812415    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-vvrmt"
Jul 21 04:14:08.263874 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.263820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:08.462916 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.462875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:08.985917 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.985877    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"]
Jul 21 04:14:08.989852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.989826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:08.992753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.992725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 04:14:08.992916 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.992799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 04:14:08.993277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.993257    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 04:14:08.993660 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.993646    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 04:14:08.998076 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:08.998026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:09.013825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.013792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"]
Jul 21 04:14:09.137316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.137270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c447fe-12fb-4b72-8f1d-7112692a580e-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.137316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.137319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c447fe-12fb-4b72-8f1d-7112692a580e-tmp\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.137577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.137465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js48n\" (UniqueName: \"kubernetes.io/projected/70c447fe-12fb-4b72-8f1d-7112692a580e-kube-api-access-js48n\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.215005 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.214966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:09.237791 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.237709    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nv8vc"]
Jul 21 04:14:09.238083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.238055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c447fe-12fb-4b72-8f1d-7112692a580e-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.238198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.238122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c447fe-12fb-4b72-8f1d-7112692a580e-tmp\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.238312 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.238247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js48n\" (UniqueName: \"kubernetes.io/projected/70c447fe-12fb-4b72-8f1d-7112692a580e-kube-api-access-js48n\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.240956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.240918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c447fe-12fb-4b72-8f1d-7112692a580e-tmp\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.241368 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.241344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c447fe-12fb-4b72-8f1d-7112692a580e-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.241591 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.241573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.248039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.248013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 04:14:09.248442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.248425    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xgthg\""
Jul 21 04:14:09.280123 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.280088    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nv8vc"]
Jul 21 04:14:09.281076 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.281049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js48n\" (UniqueName: \"kubernetes.io/projected/70c447fe-12fb-4b72-8f1d-7112692a580e-kube-api-access-js48n\") pod \"kube-auth-proxy-6fd7c746b6-f76dh\" (UID: \"70c447fe-12fb-4b72-8f1d-7112692a580e\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.300434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.300402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"
Jul 21 04:14:09.338841 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.338785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.339038 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.338849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lng\" (UniqueName: \"kubernetes.io/projected/1c5ac405-7440-435a-a3a0-4d41a92855e9-kube-api-access-c8lng\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.404005 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.403929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:09.439760 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.439720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.439957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.439820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lng\" (UniqueName: \"kubernetes.io/projected/1c5ac405-7440-435a-a3a0-4d41a92855e9-kube-api-access-c8lng\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.439957 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:14:09.439906    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 04:14:09.440071 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:14:09.439996    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert podName:1c5ac405-7440-435a-a3a0-4d41a92855e9 nodeName:}" failed. No retries permitted until 2026-07-21 04:14:09.939969844 +0000 UTC m=+598.690020323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert") pod "odh-model-controller-7998c67dc4-nv8vc" (UID: "1c5ac405-7440-435a-a3a0-4d41a92855e9") : secret "odh-model-controller-webhook-cert" not found
Jul 21 04:14:09.449011 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.448983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lng\" (UniqueName: \"kubernetes.io/projected/1c5ac405-7440-435a-a3a0-4d41a92855e9-kube-api-access-c8lng\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.453109 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.453054    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh"]
Jul 21 04:14:09.455426 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:09.455400    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c447fe_12fb_4b72_8f1d_7112692a580e.slice/crio-330e3e5584e6324cb9e42d7a1171af71762f82c2bcdc105a89bb58dbf5069b74 WatchSource:0}: Error finding container 330e3e5584e6324cb9e42d7a1171af71762f82c2bcdc105a89bb58dbf5069b74: Status 404 returned error can't find the container with id 330e3e5584e6324cb9e42d7a1171af71762f82c2bcdc105a89bb58dbf5069b74
Jul 21 04:14:09.486316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.486261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:09.857284 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.857195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:09.874729 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.874696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh" event={"ID":"70c447fe-12fb-4b72-8f1d-7112692a580e","Type":"ContainerStarted","Data":"330e3e5584e6324cb9e42d7a1171af71762f82c2bcdc105a89bb58dbf5069b74"}
Jul 21 04:14:09.945915 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.945878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:09.948443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:09.948420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5ac405-7440-435a-a3a0-4d41a92855e9-cert\") pod \"odh-model-controller-7998c67dc4-nv8vc\" (UID: \"1c5ac405-7440-435a-a3a0-4d41a92855e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:10.103438 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.103394    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx85s"]
Jul 21 04:14:10.107989 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.107923    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.115544 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.115471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 04:14:10.115689 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.115671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5wnbg\""
Jul 21 04:14:10.133908 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.133872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:10.134785 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.134752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx85s"]
Jul 21 04:14:10.163836 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.163804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:10.233552 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.233447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:10.250015 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.249781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded1d335-55ac-4121-8b0f-8128fa6671ee-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.250015 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.249823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7f9\" (UniqueName: \"kubernetes.io/projected/ded1d335-55ac-4121-8b0f-8128fa6671ee-kube-api-access-7c7f9\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.336045 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.335782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nv8vc"]
Jul 21 04:14:10.339531 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:10.339495    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5ac405_7440_435a_a3a0_4d41a92855e9.slice/crio-20b9de6065abeb8a699784c2f430f9bfcd3b902532623c46fd3d7e47c92b05fd WatchSource:0}: Error finding container 20b9de6065abeb8a699784c2f430f9bfcd3b902532623c46fd3d7e47c92b05fd: Status 404 returned error can't find the container with id 20b9de6065abeb8a699784c2f430f9bfcd3b902532623c46fd3d7e47c92b05fd
Jul 21 04:14:10.350679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.350399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded1d335-55ac-4121-8b0f-8128fa6671ee-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.350679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.350445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7f9\" (UniqueName: \"kubernetes.io/projected/ded1d335-55ac-4121-8b0f-8128fa6671ee-kube-api-access-7c7f9\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.353750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.353722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded1d335-55ac-4121-8b0f-8128fa6671ee-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.365568 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.365484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7f9\" (UniqueName: \"kubernetes.io/projected/ded1d335-55ac-4121-8b0f-8128fa6671ee-kube-api-access-7c7f9\") pod \"model-serving-api-54d89bd5fc-gx85s\" (UID: \"ded1d335-55ac-4121-8b0f-8128fa6671ee\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.419134 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.419097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:10.469991 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.469951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:10.478441 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.478063    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:10.482138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.482110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.484786 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.484553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w4qmw\""
Jul 21 04:14:10.484786 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.484581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 04:14:10.484993 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.484942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 04:14:10.485165 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.485152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 04:14:10.485562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.485394    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 04:14:10.497048 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.496278    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:10.568813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.568741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:10.601628 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.601600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx85s"]
Jul 21 04:14:10.604843 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:10.604812    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded1d335_55ac_4121_8b0f_8128fa6671ee.slice/crio-eaecbfdf92b0b97f1f3748ec54e47bba0f79fafd88d0acef9487a054227417b4 WatchSource:0}: Error finding container eaecbfdf92b0b97f1f3748ec54e47bba0f79fafd88d0acef9487a054227417b4: Status 404 returned error can't find the container with id eaecbfdf92b0b97f1f3748ec54e47bba0f79fafd88d0acef9487a054227417b4
Jul 21 04:14:10.654311 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhttz\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654622 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.654622 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.654545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755578 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755578 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.755842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.756040 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.755958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhttz\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.757405 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.757366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.758752 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.758726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.759135 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.759109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.759270 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.759116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.759270 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.759195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.763780 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.763753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.763964 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.763944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhttz\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz\") pod \"istiod-openshift-gateway-7574459656-vcfs5\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.800700 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.800663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:10.882501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.882437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc" event={"ID":"1c5ac405-7440-435a-a3a0-4d41a92855e9","Type":"ContainerStarted","Data":"20b9de6065abeb8a699784c2f430f9bfcd3b902532623c46fd3d7e47c92b05fd"}
Jul 21 04:14:10.884230 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.884178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s" event={"ID":"ded1d335-55ac-4121-8b0f-8128fa6671ee","Type":"ContainerStarted","Data":"eaecbfdf92b0b97f1f3748ec54e47bba0f79fafd88d0acef9487a054227417b4"}
Jul 21 04:14:10.969886 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:10.969806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:10.975299 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:10.975265    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6129fc8_2393_4d39_95fb_ea70fe375c6c.slice/crio-09271c81e2f766515937e80490a0020f4a2b2acb55135cd265e3f637bbbbc492 WatchSource:0}: Error finding container 09271c81e2f766515937e80490a0020f4a2b2acb55135cd265e3f637bbbbc492: Status 404 returned error can't find the container with id 09271c81e2f766515937e80490a0020f4a2b2acb55135cd265e3f637bbbbc492
Jul 21 04:14:11.645922 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:11.645780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:11.894101 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:11.893970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" event={"ID":"c6129fc8-2393-4d39-95fb-ea70fe375c6c","Type":"ContainerStarted","Data":"09271c81e2f766515937e80490a0020f4a2b2acb55135cd265e3f637bbbbc492"}
Jul 21 04:14:15.634418 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.634384    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 04:14:15.652047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.651434    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:14:15.652047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.651521    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:14:15.660282 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.660258    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:14:15.660884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.660840    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:14:15.671439 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.671409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:14:15.672637 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.672554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:14:15.918732 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.918679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc" event={"ID":"1c5ac405-7440-435a-a3a0-4d41a92855e9","Type":"ContainerStarted","Data":"e773c1d223cefdf668149f47b7ba58d6e6ac87a8083f6606e0608e91c0390e15"}
Jul 21 04:14:15.918929 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.918812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:15.921116 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.921088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" event={"ID":"c6129fc8-2393-4d39-95fb-ea70fe375c6c","Type":"ContainerStarted","Data":"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"}
Jul 21 04:14:15.921282 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.921150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:15.923487 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.923456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s" event={"ID":"ded1d335-55ac-4121-8b0f-8128fa6671ee","Type":"ContainerStarted","Data":"efedc685da88ef61725777c5314da63edce46cbdc5efcb7fcd5f3fb2f98f8613"}
Jul 21 04:14:15.923876 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.923841    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:15.925689 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.925639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh" event={"ID":"70c447fe-12fb-4b72-8f1d-7112692a580e","Type":"ContainerStarted","Data":"b247849a4a0ae61a364d025400467b4bc97efdd8881f9725127018d377b49b1b"}
Jul 21 04:14:15.936670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.936607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc" podStartSLOduration=1.627507391 podStartE2EDuration="6.936590264s" totalImagesPullingTime="5.309082873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:15.935379087 +0000 UTC m=+604.685429587" watchObservedRunningTime="2026-07-21 04:14:15.936590264 +0000 UTC m=+604.686640761"
Jul 21 04:14:15.952006 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.951956    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-f76dh" podStartSLOduration=1.77744082 podStartE2EDuration="7.951940393s" totalImagesPullingTime="6.174499573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:15.950235925 +0000 UTC m=+604.700286418" watchObservedRunningTime="2026-07-21 04:14:15.951940393 +0000 UTC m=+604.701990916"
Jul 21 04:14:15.966965 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.966907    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s" podStartSLOduration=0.938566264 podStartE2EDuration="5.966886814s" totalImagesPullingTime="5.02832055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:15.965398374 +0000 UTC m=+604.715448873" watchObservedRunningTime="2026-07-21 04:14:15.966886814 +0000 UTC m=+604.716937311"
Jul 21 04:14:15.985409 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:15.985335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" podStartSLOduration=1.313405447 podStartE2EDuration="5.985310032s" totalImagesPullingTime="4.671904585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:15.984205429 +0000 UTC m=+604.734255926" watchObservedRunningTime="2026-07-21 04:14:15.985310032 +0000 UTC m=+604.735360529"
Jul 21 04:14:16.396818 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:16.396613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:16.933401 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:16.933366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:17.966639 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:17.966600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:20.772045 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.772001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:20.849803 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.849760    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"]
Jul 21 04:14:20.856036 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.856011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:20.860958 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.860929    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 04:14:20.860958 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.860953    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sdlxl\""
Jul 21 04:14:20.866663 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.866631    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"]
Jul 21 04:14:20.870679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.870652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:20.874813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.874372    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9wvbd\""
Jul 21 04:14:20.876820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.876792    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 04:14:20.877407 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.877382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"]
Jul 21 04:14:20.888746 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.888711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"]
Jul 21 04:14:20.921845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.921800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:20.952059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.952029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcxv8\" (UniqueName: \"kubernetes.io/projected/f5047227-9555-47ec-8c22-68003228119a-kube-api-access-vcxv8\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:20.952249 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.952102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5047227-9555-47ec-8c22-68003228119a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:20.952249 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.952145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xcz2\" (UniqueName: \"kubernetes.io/projected/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-kube-api-access-7xcz2\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:20.952249 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.952163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:20.991120 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:20.991086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:21.053394 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.053312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcxv8\" (UniqueName: \"kubernetes.io/projected/f5047227-9555-47ec-8c22-68003228119a-kube-api-access-vcxv8\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:21.053560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.053422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5047227-9555-47ec-8c22-68003228119a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:21.053560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.053471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xcz2\" (UniqueName: \"kubernetes.io/projected/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-kube-api-access-7xcz2\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.053560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.053498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.053729 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:14:21.053632    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 21 04:14:21.053729 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:14:21.053702    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert podName:05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67 nodeName:}" failed. No retries permitted until 2026-07-21 04:14:21.553681315 +0000 UTC m=+610.303731813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert") pod "kserve-controller-manager-d6f4b65b8-ffn4h" (UID: "05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67") : secret "kserve-webhook-server-cert" not found
Jul 21 04:14:21.056192 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.056164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5047227-9555-47ec-8c22-68003228119a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:21.062605 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.062577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcxv8\" (UniqueName: \"kubernetes.io/projected/f5047227-9555-47ec-8c22-68003228119a-kube-api-access-vcxv8\") pod \"llmisvc-controller-manager-777c6bd7d5-kzpfs\" (UID: \"f5047227-9555-47ec-8c22-68003228119a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:21.064017 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.064000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xcz2\" (UniqueName: \"kubernetes.io/projected/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-kube-api-access-7xcz2\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.143747 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.143701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:21.182732 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.182695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:21.313443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.313353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:21.401951 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.401925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"]
Jul 21 04:14:21.404490 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:21.404460    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5047227_9555_47ec_8c22_68003228119a.slice/crio-4876238f0082f624d52aaee5532273201e5a148eb6e1f1050477497fced0b34b WatchSource:0}: Error finding container 4876238f0082f624d52aaee5532273201e5a148eb6e1f1050477497fced0b34b: Status 404 returned error can't find the container with id 4876238f0082f624d52aaee5532273201e5a148eb6e1f1050477497fced0b34b
Jul 21 04:14:21.405866 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.405849    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:14:21.558567 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.558532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.561028 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.561007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffn4h\" (UID: \"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.767741 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.767705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:21.918081 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.918050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"]
Jul 21 04:14:21.922190 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:14:21.922166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05983b1f_ef2f_4138_a7bb_c5bd8cc8ed67.slice/crio-c1712fd0e3cd56f45ae82e4f344b775f747eb1516742139b7db2680d77f6739e WatchSource:0}: Error finding container c1712fd0e3cd56f45ae82e4f344b775f747eb1516742139b7db2680d77f6739e: Status 404 returned error can't find the container with id c1712fd0e3cd56f45ae82e4f344b775f747eb1516742139b7db2680d77f6739e
Jul 21 04:14:21.955838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.955799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs" event={"ID":"f5047227-9555-47ec-8c22-68003228119a","Type":"ContainerStarted","Data":"4876238f0082f624d52aaee5532273201e5a148eb6e1f1050477497fced0b34b"}
Jul 21 04:14:21.957138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:21.957113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h" event={"ID":"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67","Type":"ContainerStarted","Data":"c1712fd0e3cd56f45ae82e4f344b775f747eb1516742139b7db2680d77f6739e"}
Jul 21 04:14:22.708805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:22.708766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:22.815023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:22.814986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:23.851370 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:23.851320    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:23.851840 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:23.851573    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" podUID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" containerName="discovery" containerID="cri-o://133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242" gracePeriod=30
Jul 21 04:14:24.843272 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.843244    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889597    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhttz\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.889887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.889899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts\") pod \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\" (UID: \"c6129fc8-2393-4d39-95fb-ea70fe375c6c\") "
Jul 21 04:14:24.891482 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.891432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:14:24.893703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.893626    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:14:24.893817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.893700    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs" (OuterVolumeSpecName: "local-certs") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:24.893817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.893766    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts" (OuterVolumeSpecName: "cacerts") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:14:24.893966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.893827    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:14:24.894074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.894055    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz" (OuterVolumeSpecName: "kube-api-access-bhttz") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "kube-api-access-bhttz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:14:24.894299 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.894274    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6129fc8-2393-4d39-95fb-ea70fe375c6c" (UID: "c6129fc8-2393-4d39-95fb-ea70fe375c6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:14:24.974297 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.974199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h" event={"ID":"05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67","Type":"ContainerStarted","Data":"2aa52b58dc4f11eb8d9811ad5a214a17b7c78560d54101ac26de33879c0d733b"}
Jul 21 04:14:24.974461 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.974321    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:24.975517 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.975491    2578 generic.go:356] "Generic (PLEG): container finished" podID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" containerID="133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242" exitCode=0
Jul 21 04:14:24.975613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.975530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"
Jul 21 04:14:24.975613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.975563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" event={"ID":"c6129fc8-2393-4d39-95fb-ea70fe375c6c","Type":"ContainerDied","Data":"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"}
Jul 21 04:14:24.975613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.975603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5" event={"ID":"c6129fc8-2393-4d39-95fb-ea70fe375c6c","Type":"ContainerDied","Data":"09271c81e2f766515937e80490a0020f4a2b2acb55135cd265e3f637bbbbc492"}
Jul 21 04:14:24.975722 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.975630    2578 scope.go:117] "RemoveContainer" containerID="133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"
Jul 21 04:14:24.985019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.984992    2578 scope.go:117] "RemoveContainer" containerID="133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"
Jul 21 04:14:24.985325 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:14:24.985305    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242\": container with ID starting with 133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242 not found: ID does not exist" containerID="133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"
Jul 21 04:14:24.985425 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.985334    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242"} err="failed to get container status \"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242\": rpc error: code = NotFound desc = could not find container \"133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242\": container with ID starting with 133baa58b304da9c72b51e4f177ef9e926dfd6264b0bccf4f4f1bf594d4db242 not found: ID does not exist"
Jul 21 04:14:24.990740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990717    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-dns-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990740    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhttz\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-kube-api-access-bhttz\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990751    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-cacerts\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990761    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6129fc8-2393-4d39-95fb-ea70fe375c6c-local-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990769    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-csr-ca-configmap\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990777    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-kubeconfig\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.990881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.990785    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6129fc8-2393-4d39-95fb-ea70fe375c6c-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:14:24.994476 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:24.994432    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h" podStartSLOduration=2.061483042 podStartE2EDuration="4.994418053s" totalImagesPullingTime="2.932935011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:24.993797112 +0000 UTC m=+613.743847609" watchObservedRunningTime="2026-07-21 04:14:24.994418053 +0000 UTC m=+613.744468550"
Jul 21 04:14:25.010962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:25.010933    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:25.017612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:25.017580    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vcfs5"]
Jul 21 04:14:25.780848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:25.780804    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" path="/var/lib/kubelet/pods/c6129fc8-2393-4d39-95fb-ea70fe375c6c/volumes"
Jul 21 04:14:25.981202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:25.981172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs" event={"ID":"f5047227-9555-47ec-8c22-68003228119a","Type":"ContainerStarted","Data":"b9e877836af2782452361a88b968b19b75ebf5c7c4c1cfcb0c748aa115b8baa0"}
Jul 21 04:14:25.981682 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:25.981286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:14:26.006110 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:26.006054    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs" podStartSLOduration=2.5533049610000003 podStartE2EDuration="6.006035332s" totalImagesPullingTime="3.452730371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:26.004529697 +0000 UTC m=+614.754580176" watchObservedRunningTime="2026-07-21 04:14:26.006035332 +0000 UTC m=+614.756085829"
Jul 21 04:14:26.933316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:26.933281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nv8vc"
Jul 21 04:14:26.935332 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:26.935310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gx85s"
Jul 21 04:14:28.899640 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:28.899599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:28.960678 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:28.960638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:30.775584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:30.775535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:30.830322 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:30.830282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:54.462858 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:54.462816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:14:55.988194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:55.988164    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffn4h"
Jul 21 04:14:56.991918 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:14:56.991880    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kzpfs"
Jul 21 04:15:09.886737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:09.886693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:09.988739 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:09.988701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:10.031095 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.031057    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:10.031454 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.031431    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" containerName="discovery"
Jul 21 04:15:10.031454 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.031448    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" containerName="discovery"
Jul 21 04:15:10.031635 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.031503    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6129fc8-2393-4d39-95fb-ea70fe375c6c" containerName="discovery"
Jul 21 04:15:10.034340 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.034323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:10.036852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.036828    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 04:15:10.036996 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.036973    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 04:15:10.046603 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.046573    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:10.084979 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.084933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrp5\" (UniqueName: \"kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5\") pod \"kuadrant-operator-catalog-fqch2\" (UID: \"95190a64-0dfd-49e4-94a5-1f48590d3cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:10.091519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.091486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:10.185381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.185345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrp5\" (UniqueName: \"kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5\") pod \"kuadrant-operator-catalog-fqch2\" (UID: \"95190a64-0dfd-49e4-94a5-1f48590d3cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:10.196734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.196705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrp5\" (UniqueName: \"kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5\") pod \"kuadrant-operator-catalog-fqch2\" (UID: \"95190a64-0dfd-49e4-94a5-1f48590d3cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:10.344510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.344475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:10.393030 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.392994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:10.483417 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.483379    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:10.486272 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:10.486240    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95190a64_0dfd_49e4_94a5_1f48590d3cb7.slice/crio-2aac66e249636e04faada5532f158bb0f438cdff9182b830e0cde806af141e02 WatchSource:0}: Error finding container 2aac66e249636e04faada5532f158bb0f438cdff9182b830e0cde806af141e02: Status 404 returned error can't find the container with id 2aac66e249636e04faada5532f158bb0f438cdff9182b830e0cde806af141e02
Jul 21 04:15:10.602149 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.602110    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5n5q"]
Jul 21 04:15:10.606271 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.606255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:10.608424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.608404    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-c7pj5\""
Jul 21 04:15:10.612432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.612410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5n5q"]
Jul 21 04:15:10.688997 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.688962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcx8\" (UniqueName: \"kubernetes.io/projected/724eefc5-daee-4109-9d4d-84bf1cc87dce-kube-api-access-cwcx8\") pod \"kuadrant-operator-catalog-r5n5q\" (UID: \"724eefc5-daee-4109-9d4d-84bf1cc87dce\") " pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:10.790514 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.790343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcx8\" (UniqueName: \"kubernetes.io/projected/724eefc5-daee-4109-9d4d-84bf1cc87dce-kube-api-access-cwcx8\") pod \"kuadrant-operator-catalog-r5n5q\" (UID: \"724eefc5-daee-4109-9d4d-84bf1cc87dce\") " pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:10.800420 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.800389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcx8\" (UniqueName: \"kubernetes.io/projected/724eefc5-daee-4109-9d4d-84bf1cc87dce-kube-api-access-cwcx8\") pod \"kuadrant-operator-catalog-r5n5q\" (UID: \"724eefc5-daee-4109-9d4d-84bf1cc87dce\") " pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:10.894992 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.894953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:10.916910 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:10.916874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:11.029638 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:11.029439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:11.060707 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:11.060677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5n5q"]
Jul 21 04:15:11.063679 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:11.063656    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724eefc5_daee_4109_9d4d_84bf1cc87dce.slice/crio-9e356c43ad37c46ca5846613d44ec7033b7e0bf92c8037a67b5e83832d837c5d WatchSource:0}: Error finding container 9e356c43ad37c46ca5846613d44ec7033b7e0bf92c8037a67b5e83832d837c5d: Status 404 returned error can't find the container with id 9e356c43ad37c46ca5846613d44ec7033b7e0bf92c8037a67b5e83832d837c5d
Jul 21 04:15:11.191685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:11.191642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" event={"ID":"95190a64-0dfd-49e4-94a5-1f48590d3cb7","Type":"ContainerStarted","Data":"2aac66e249636e04faada5532f158bb0f438cdff9182b830e0cde806af141e02"}
Jul 21 04:15:11.193055 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:11.193022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q" event={"ID":"724eefc5-daee-4109-9d4d-84bf1cc87dce","Type":"ContainerStarted","Data":"9e356c43ad37c46ca5846613d44ec7033b7e0bf92c8037a67b5e83832d837c5d"}
Jul 21 04:15:13.205945 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.205902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" event={"ID":"95190a64-0dfd-49e4-94a5-1f48590d3cb7","Type":"ContainerStarted","Data":"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"}
Jul 21 04:15:13.206526 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.205967    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" podUID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" containerName="registry-server" containerID="cri-o://26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15" gracePeriod=2
Jul 21 04:15:13.207562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.207534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q" event={"ID":"724eefc5-daee-4109-9d4d-84bf1cc87dce","Type":"ContainerStarted","Data":"72c221ccaa30c6baa2f3d53b9b1f16b56a9e0ddc0018b37b7aa47740ecd0254b"}
Jul 21 04:15:13.221610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.221568    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" podStartSLOduration=1.197469002 podStartE2EDuration="3.221551312s" totalImagesPullingTime="2.02408231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:13.220605904 +0000 UTC m=+661.970656403" watchObservedRunningTime="2026-07-21 04:15:13.221551312 +0000 UTC m=+661.971601809"
Jul 21 04:15:13.235438 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.235387    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q" podStartSLOduration=1.787930023 podStartE2EDuration="3.235364517s" totalImagesPullingTime="1.447434494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:13.23433682 +0000 UTC m=+661.984387320" watchObservedRunningTime="2026-07-21 04:15:13.235364517 +0000 UTC m=+661.985415018"
Jul 21 04:15:13.452437 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.452413    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:13.511666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.511570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjrp5\" (UniqueName: \"kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5\") pod \"95190a64-0dfd-49e4-94a5-1f48590d3cb7\" (UID: \"95190a64-0dfd-49e4-94a5-1f48590d3cb7\") "
Jul 21 04:15:13.513936 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.513909    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5" (OuterVolumeSpecName: "kube-api-access-sjrp5") pod "95190a64-0dfd-49e4-94a5-1f48590d3cb7" (UID: "95190a64-0dfd-49e4-94a5-1f48590d3cb7"). InnerVolumeSpecName "kube-api-access-sjrp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:15:13.612593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:13.612555    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjrp5\" (UniqueName: \"kubernetes.io/projected/95190a64-0dfd-49e4-94a5-1f48590d3cb7-kube-api-access-sjrp5\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:15:14.222010 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.221975    2578 generic.go:356] "Generic (PLEG): container finished" podID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" containerID="26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15" exitCode=0
Jul 21 04:15:14.222462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.222034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" event={"ID":"95190a64-0dfd-49e4-94a5-1f48590d3cb7","Type":"ContainerDied","Data":"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"}
Jul 21 04:15:14.222462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.222078    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqch2"
Jul 21 04:15:14.222462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.222103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqch2" event={"ID":"95190a64-0dfd-49e4-94a5-1f48590d3cb7","Type":"ContainerDied","Data":"2aac66e249636e04faada5532f158bb0f438cdff9182b830e0cde806af141e02"}
Jul 21 04:15:14.222846 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.222132    2578 scope.go:117] "RemoveContainer" containerID="26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"
Jul 21 04:15:14.231539 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.231510    2578 scope.go:117] "RemoveContainer" containerID="26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"
Jul 21 04:15:14.231888 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:15:14.231864    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15\": container with ID starting with 26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15 not found: ID does not exist" containerID="26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"
Jul 21 04:15:14.231972 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.231901    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15"} err="failed to get container status \"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15\": rpc error: code = NotFound desc = could not find container \"26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15\": container with ID starting with 26cfdf2184ac1a6b5205dd139c4c9a512e4011ab713a23c069d5192071bf0b15 not found: ID does not exist"
Jul 21 04:15:14.238025 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.237992    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:14.240102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:14.240078    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqch2"]
Jul 21 04:15:15.780486 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:15.780452    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" path="/var/lib/kubelet/pods/95190a64-0dfd-49e4-94a5-1f48590d3cb7/volumes"
Jul 21 04:15:20.918035 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:20.917996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:20.918486 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:20.918072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:20.941464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:20.941437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:21.277929 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:21.277850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r5n5q"
Jul 21 04:15:33.901376 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:33.901333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:34.696053 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:34.696017    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:37.760580 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.760545    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"]
Jul 21 04:15:37.760948 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.760902    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" containerName="registry-server"
Jul 21 04:15:37.760948 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.760915    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" containerName="registry-server"
Jul 21 04:15:37.761029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.760965    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95190a64-0dfd-49e4-94a5-1f48590d3cb7" containerName="registry-server"
Jul 21 04:15:37.763789 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.763772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:37.767572 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.767547    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vqlf9\""
Jul 21 04:15:37.781698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.781666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"]
Jul 21 04:15:37.825546 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.825509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtqqw\" (UniqueName: \"kubernetes.io/projected/c08ddc02-5e6d-4467-9bb0-7822dad74855-kube-api-access-qtqqw\") pod \"authorino-operator-75cc8d5cb7-fs5vj\" (UID: \"c08ddc02-5e6d-4467-9bb0-7822dad74855\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:37.926541 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.926506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtqqw\" (UniqueName: \"kubernetes.io/projected/c08ddc02-5e6d-4467-9bb0-7822dad74855-kube-api-access-qtqqw\") pod \"authorino-operator-75cc8d5cb7-fs5vj\" (UID: \"c08ddc02-5e6d-4467-9bb0-7822dad74855\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:37.938976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:37.938948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtqqw\" (UniqueName: \"kubernetes.io/projected/c08ddc02-5e6d-4467-9bb0-7822dad74855-kube-api-access-qtqqw\") pod \"authorino-operator-75cc8d5cb7-fs5vj\" (UID: \"c08ddc02-5e6d-4467-9bb0-7822dad74855\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:38.074160 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:38.074068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:38.207549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:38.207512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"]
Jul 21 04:15:38.210687 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:38.210660    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08ddc02_5e6d_4467_9bb0_7822dad74855.slice/crio-80ef066bdcc0c5b647e3dac555c9695f5a7afd6c422c0a31530683f1e81009fc WatchSource:0}: Error finding container 80ef066bdcc0c5b647e3dac555c9695f5a7afd6c422c0a31530683f1e81009fc: Status 404 returned error can't find the container with id 80ef066bdcc0c5b647e3dac555c9695f5a7afd6c422c0a31530683f1e81009fc
Jul 21 04:15:38.330562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:38.330472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj" event={"ID":"c08ddc02-5e6d-4467-9bb0-7822dad74855","Type":"ContainerStarted","Data":"80ef066bdcc0c5b647e3dac555c9695f5a7afd6c422c0a31530683f1e81009fc"}
Jul 21 04:15:39.113057 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:39.113003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:41.055347 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.055296    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"]
Jul 21 04:15:41.058806 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.058788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:41.061129 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.061108    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-79kzs\""
Jul 21 04:15:41.073232 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.073191    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"]
Jul 21 04:15:41.157185 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.157145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph68b\" (UniqueName: \"kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b\") pod \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" (UID: \"0d13457c-90c6-420b-9b98-26bdca4e80db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:41.257869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.257835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph68b\" (UniqueName: \"kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b\") pod \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" (UID: \"0d13457c-90c6-420b-9b98-26bdca4e80db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:41.267105 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.267069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph68b\" (UniqueName: \"kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b\") pod \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" (UID: \"0d13457c-90c6-420b-9b98-26bdca4e80db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:41.348372 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.348280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj" event={"ID":"c08ddc02-5e6d-4467-9bb0-7822dad74855","Type":"ContainerStarted","Data":"54a0e5658f90c07df03e1db6cec2681d50749d476b20735565b08400b1d97c87"}
Jul 21 04:15:41.348372 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.348364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:41.368399 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.368358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:41.370366 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.370318    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj" podStartSLOduration=2.012320734 podStartE2EDuration="4.370302664s" totalImagesPullingTime="2.35798193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:41.369536948 +0000 UTC m=+690.119587445" watchObservedRunningTime="2026-07-21 04:15:41.370302664 +0000 UTC m=+690.120353161"
Jul 21 04:15:41.382421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.382391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:41.470751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.470693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:41.530512 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:41.530480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"]
Jul 21 04:15:41.533241 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:41.533196    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d13457c_90c6_420b_9b98_26bdca4e80db.slice/crio-4acb0d2b4ec4153545faaf632398360992507b1d0540bdadc2267225e1a086c3 WatchSource:0}: Error finding container 4acb0d2b4ec4153545faaf632398360992507b1d0540bdadc2267225e1a086c3: Status 404 returned error can't find the container with id 4acb0d2b4ec4153545faaf632398360992507b1d0540bdadc2267225e1a086c3
Jul 21 04:15:42.127251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:42.127183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:42.355273 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:42.355233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm" event={"ID":"0d13457c-90c6-420b-9b98-26bdca4e80db","Type":"ContainerStarted","Data":"4acb0d2b4ec4153545faaf632398360992507b1d0540bdadc2267225e1a086c3"}
Jul 21 04:15:43.200655 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:43.200624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:43.361415 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:43.361370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm" event={"ID":"0d13457c-90c6-420b-9b98-26bdca4e80db","Type":"ContainerStarted","Data":"3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc"}
Jul 21 04:15:43.361593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:43.361513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:43.379670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:43.379614    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm" podStartSLOduration=0.765885636 podStartE2EDuration="2.379596615s" totalImagesPullingTime="1.613710979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:43.378627229 +0000 UTC m=+692.128677752" watchObservedRunningTime="2026-07-21 04:15:43.379596615 +0000 UTC m=+692.129647153"
Jul 21 04:15:44.221996 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.221962    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"]
Jul 21 04:15:44.225377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.225354    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:44.227673 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.227649    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 04:15:44.228199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.228177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5m497\""
Jul 21 04:15:44.236669 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.236645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"]
Jul 21 04:15:44.387998 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.387963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shmsn\" (UniqueName: \"kubernetes.io/projected/0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa-kube-api-access-shmsn\") pod \"dns-operator-controller-manager-864dd78c4c-8l5xz\" (UID: \"0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:44.488578 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.488488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmsn\" (UniqueName: \"kubernetes.io/projected/0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa-kube-api-access-shmsn\") pod \"dns-operator-controller-manager-864dd78c4c-8l5xz\" (UID: \"0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:44.496743 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.496711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shmsn\" (UniqueName: \"kubernetes.io/projected/0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa-kube-api-access-shmsn\") pod \"dns-operator-controller-manager-864dd78c4c-8l5xz\" (UID: \"0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:44.536637 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.536601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:44.695908 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.695882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"]
Jul 21 04:15:44.698718 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:44.698682    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac9c764_7fe7_4d09_b36f_dd9a1bd7aefa.slice/crio-450cfa861e8338ff31d1beaac1465a335eaa4d6ea572d00c36f9c603806b7326 WatchSource:0}: Error finding container 450cfa861e8338ff31d1beaac1465a335eaa4d6ea572d00c36f9c603806b7326: Status 404 returned error can't find the container with id 450cfa861e8338ff31d1beaac1465a335eaa4d6ea572d00c36f9c603806b7326
Jul 21 04:15:44.734945 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.734908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:44.836037 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:44.835937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:45.123997 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:45.123904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:45.372151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:45.372105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz" event={"ID":"0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa","Type":"ContainerStarted","Data":"450cfa861e8338ff31d1beaac1465a335eaa4d6ea572d00c36f9c603806b7326"}
Jul 21 04:15:45.780966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:45.780909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:48.389654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:48.389618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz" event={"ID":"0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa","Type":"ContainerStarted","Data":"b41cbd0e0f4a4d37acddbcafe4e624d8077d9913066d73727dfcfa13c9db6419"}
Jul 21 04:15:48.390073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:48.389691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:15:48.414442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:48.414381    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz" podStartSLOduration=1.794369869 podStartE2EDuration="4.41436238s" totalImagesPullingTime="2.619992511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:48.41286881 +0000 UTC m=+697.162919307" watchObservedRunningTime="2026-07-21 04:15:48.41436238 +0000 UTC m=+697.164412902"
Jul 21 04:15:48.997146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:48.997106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:49.521430 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.521385    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"]
Jul 21 04:15:49.524820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.524803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.527925 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.527904    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d5s6t\""
Jul 21 04:15:49.543851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.543824    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"]
Jul 21 04:15:49.642618 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.642576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.642788 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.642690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbl9h\" (UniqueName: \"kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.743534 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.743485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbl9h\" (UniqueName: \"kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.743719 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.743568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.743992 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.743972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.758093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.758058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbl9h\" (UniqueName: \"kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.835157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.835051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:49.975280 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:49.975253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"]
Jul 21 04:15:49.978307 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:15:49.978282    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ec5dfa_c045_45be_af42_eab4ba2d3663.slice/crio-5b7a4eca8263cd555929a26a724421067d44ab3031a1d71b780b7668566b9b81 WatchSource:0}: Error finding container 5b7a4eca8263cd555929a26a724421067d44ab3031a1d71b780b7668566b9b81: Status 404 returned error can't find the container with id 5b7a4eca8263cd555929a26a724421067d44ab3031a1d71b780b7668566b9b81
Jul 21 04:15:50.400268 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:50.400207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl" event={"ID":"c0ec5dfa-c045-45be-af42-eab4ba2d3663","Type":"ContainerStarted","Data":"5b7a4eca8263cd555929a26a724421067d44ab3031a1d71b780b7668566b9b81"}
Jul 21 04:15:50.920314 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:50.920167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:51.019777 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:51.019744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:51.329489 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:51.329403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:51.427670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:51.427640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:52.357980 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:52.357946    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fs5vj"
Jul 21 04:15:54.369202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:54.369171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:15:54.507318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:54.507287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:54.607919 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:54.607884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:55.643172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:55.643130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:55.743156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:55.743123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:55.842959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:55.842921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:55.942903 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:55.942870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:56.434162 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:56.434122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl" event={"ID":"c0ec5dfa-c045-45be-af42-eab4ba2d3663","Type":"ContainerStarted","Data":"f7e1f36fe6af2cc93f5f68f90bba858db9766a7806926d7d3f3ddb7f7c92f4be"}
Jul 21 04:15:56.434423 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:56.434297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:15:56.454172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:56.454105    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl" podStartSLOduration=1.5896451470000001 podStartE2EDuration="7.454085839s" totalImagesPullingTime="5.864440692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:56.452099639 +0000 UTC m=+705.202150139" watchObservedRunningTime="2026-07-21 04:15:56.454085839 +0000 UTC m=+705.204136335"
Jul 21 04:15:56.515563 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:56.515527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:56.621001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:56.620960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:58.917048 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:58.917006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:59.007656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:59.007614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:15:59.397514 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:15:59.397435    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8l5xz"
Jul 21 04:16:01.714012 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:01.713969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:01.832561 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:01.832508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:07.441140 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:07.441054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:08.564574 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.564540    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"]
Jul 21 04:16:08.567865 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.567848    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.587053 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.587019    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"]
Jul 21 04:16:08.621692 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.621655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.621864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.621721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shpxj\" (UniqueName: \"kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.723152 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.723111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.723350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.723187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shpxj\" (UniqueName: \"kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.723525 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.723503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.735253 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.735199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shpxj\" (UniqueName: \"kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:08.879034 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:08.878945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:09.018131 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.018105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"]
Jul 21 04:16:09.020569 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:09.020539    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca13413e_8a23_4d41_9ebf_f448d674f9b4.slice/crio-bf3918a95c76fcf6a46be5794da4ec509ab2274915f88c23c43c2a5cc6f62f1d WatchSource:0}: Error finding container bf3918a95c76fcf6a46be5794da4ec509ab2274915f88c23c43c2a5cc6f62f1d: Status 404 returned error can't find the container with id bf3918a95c76fcf6a46be5794da4ec509ab2274915f88c23c43c2a5cc6f62f1d
Jul 21 04:16:09.341334 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.341286    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"]
Jul 21 04:16:09.346761 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.346729    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"]
Jul 21 04:16:09.364661 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.364628    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"]
Jul 21 04:16:09.364868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.364844    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" containerName="manager" containerID="cri-o://f7e1f36fe6af2cc93f5f68f90bba858db9766a7806926d7d3f3ddb7f7c92f4be" gracePeriod=2
Jul 21 04:16:09.373160 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.373120    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:09.373715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.373691    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" containerName="manager"
Jul 21 04:16:09.373715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.373717    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" containerName="manager"
Jul 21 04:16:09.373908 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.373829    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" containerName="manager"
Jul 21 04:16:09.377776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.377751    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"]
Jul 21 04:16:09.377870 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.377853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.391811 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.391773    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:09.397149 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.397117    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"]
Jul 21 04:16:09.397441 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.397404    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" containerName="manager" containerID="cri-o://3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc" gracePeriod=2
Jul 21 04:16:09.413999 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.412950    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"]
Jul 21 04:16:09.415276 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415250    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:09.415708 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415689    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" containerName="manager"
Jul 21 04:16:09.415708 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415708    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" containerName="manager"
Jul 21 04:16:09.415847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415724    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" containerName="manager"
Jul 21 04:16:09.415847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415733    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" containerName="manager"
Jul 21 04:16:09.415847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415793    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" containerName="manager"
Jul 21 04:16:09.415847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.415802    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" containerName="manager"
Jul 21 04:16:09.418842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.418822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.423922 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.423891    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.427330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.427306    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"]
Jul 21 04:16:09.430016 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.429991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n7vc\" (UniqueName: \"kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.430139 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.430077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.430482 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.430467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:09.439921 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.439893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:09.448689 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.448649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"]
Jul 21 04:16:09.451058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.451005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:09.463734 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.463681    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.465592 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.465558    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.467364 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.467327    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.485606 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.485549    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.504285 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.504266    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw" container="manager"
Jul 21 04:16:09.506307 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.506270    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.506428 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.506360    2578 generic.go:356] "Generic (PLEG): container finished" podID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" containerID="f7e1f36fe6af2cc93f5f68f90bba858db9766a7806926d7d3f3ddb7f7c92f4be" exitCode=0
Jul 21 04:16:09.508502 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.508470    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.510423 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.510393    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:09.530788 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.530760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.530917 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.530814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgq7\" (UniqueName: \"kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.530969 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.530955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.531019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.530999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n7vc\" (UniqueName: \"kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.531070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.531030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbfg\" (UniqueName: \"kubernetes.io/projected/12124d16-9431-4949-b519-83c2b676865f-kube-api-access-5dbfg\") pod \"limitador-operator-controller-manager-859d7b78bd-ks7b7\" (UID: \"12124d16-9431-4949-b519-83c2b676865f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:09.531122 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.531108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.543714 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.543532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n7vc\" (UniqueName: \"kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d646l\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.556250 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.556187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:09.631562 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.631529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.631971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.631582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dbfg\" (UniqueName: \"kubernetes.io/projected/12124d16-9431-4949-b519-83c2b676865f-kube-api-access-5dbfg\") pod \"limitador-operator-controller-manager-859d7b78bd-ks7b7\" (UID: \"12124d16-9431-4949-b519-83c2b676865f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:09.631971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.631639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgq7\" (UniqueName: \"kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.631971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.631933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.636272 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.636249    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.638128 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.638100    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.639613 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.639591    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:09.641173 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.641142    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.642380 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.642360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgq7\" (UniqueName: \"kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dfgwj\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.644905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.644887    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.645510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.645490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dbfg\" (UniqueName: \"kubernetes.io/projected/12124d16-9431-4949-b519-83c2b676865f-kube-api-access-5dbfg\") pod \"limitador-operator-controller-manager-859d7b78bd-ks7b7\" (UID: \"12124d16-9431-4949-b519-83c2b676865f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:09.646677 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.646654    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zbhwm\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:09.648258 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.648237    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:09.649826 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:09.649804    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pnwnl\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:09.732780 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.732745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbl9h\" (UniqueName: \"kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h\") pod \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") "
Jul 21 04:16:09.732780 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.732791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume\") pod \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\" (UID: \"c0ec5dfa-c045-45be-af42-eab4ba2d3663\") "
Jul 21 04:16:09.733049 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.732834    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph68b\" (UniqueName: \"kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b\") pod \"0d13457c-90c6-420b-9b98-26bdca4e80db\" (UID: \"0d13457c-90c6-420b-9b98-26bdca4e80db\") "
Jul 21 04:16:09.733382 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.733355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c0ec5dfa-c045-45be-af42-eab4ba2d3663" (UID: "c0ec5dfa-c045-45be-af42-eab4ba2d3663"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:16:09.735100 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.735066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h" (OuterVolumeSpecName: "kube-api-access-jbl9h") pod "c0ec5dfa-c045-45be-af42-eab4ba2d3663" (UID: "c0ec5dfa-c045-45be-af42-eab4ba2d3663"). InnerVolumeSpecName "kube-api-access-jbl9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:09.735100 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.735100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b" (OuterVolumeSpecName: "kube-api-access-ph68b") pod "0d13457c-90c6-420b-9b98-26bdca4e80db" (UID: "0d13457c-90c6-420b-9b98-26bdca4e80db"). InnerVolumeSpecName "kube-api-access-ph68b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:09.771335 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.771293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:09.778850 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.778822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:09.782236 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.782195    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d13457c-90c6-420b-9b98-26bdca4e80db" path="/var/lib/kubelet/pods/0d13457c-90c6-420b-9b98-26bdca4e80db/volumes"
Jul 21 04:16:09.782608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.782592    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ec5dfa-c045-45be-af42-eab4ba2d3663" path="/var/lib/kubelet/pods/c0ec5dfa-c045-45be-af42-eab4ba2d3663/volumes"
Jul 21 04:16:09.786116 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.786088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:09.834778 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.833725    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbl9h\" (UniqueName: \"kubernetes.io/projected/c0ec5dfa-c045-45be-af42-eab4ba2d3663-kube-api-access-jbl9h\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:09.834778 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.833765    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ec5dfa-c045-45be-af42-eab4ba2d3663-extensions-socket-volume\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:09.834778 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.833780    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph68b\" (UniqueName: \"kubernetes.io/projected/0d13457c-90c6-420b-9b98-26bdca4e80db-kube-api-access-ph68b\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:09.946496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:09.946456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:09.950531 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:09.950501    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba26bc24_8db3_4186_98b5_64f481efd76c.slice/crio-3f282a46123c5c33faf3cfab15b8605b15ceef84131b61bd0e299ca2cc4227d4 WatchSource:0}: Error finding container 3f282a46123c5c33faf3cfab15b8605b15ceef84131b61bd0e299ca2cc4227d4: Status 404 returned error can't find the container with id 3f282a46123c5c33faf3cfab15b8605b15ceef84131b61bd0e299ca2cc4227d4
Jul 21 04:16:10.017900 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.017867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:10.119280 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.119206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:10.176252 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.176203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"]
Jul 21 04:16:10.179095 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:10.179063    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12124d16_9431_4949_b519_83c2b676865f.slice/crio-58dccb88c2d58504ee1006cc8fba743b29ef0d1a372acb9271dcb5a56e671088 WatchSource:0}: Error finding container 58dccb88c2d58504ee1006cc8fba743b29ef0d1a372acb9271dcb5a56e671088: Status 404 returned error can't find the container with id 58dccb88c2d58504ee1006cc8fba743b29ef0d1a372acb9271dcb5a56e671088
Jul 21 04:16:10.180603 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.180584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:10.182162 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:10.182051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b08d33_d1b1_4e90_a389_e899574130d3.slice/crio-013cda1cb0f71c4b430ee92753431a28f7c16d78da26ec828b762a369d240b98 WatchSource:0}: Error finding container 013cda1cb0f71c4b430ee92753431a28f7c16d78da26ec828b762a369d240b98: Status 404 returned error can't find the container with id 013cda1cb0f71c4b430ee92753431a28f7c16d78da26ec828b762a369d240b98
Jul 21 04:16:10.513813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.513700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" event={"ID":"12b08d33-d1b1-4e90-a389-e899574130d3","Type":"ContainerStarted","Data":"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"}
Jul 21 04:16:10.513813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.513764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:10.513813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.513786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" event={"ID":"12b08d33-d1b1-4e90-a389-e899574130d3","Type":"ContainerStarted","Data":"013cda1cb0f71c4b430ee92753431a28f7c16d78da26ec828b762a369d240b98"}
Jul 21 04:16:10.515118 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.515094    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d13457c-90c6-420b-9b98-26bdca4e80db" containerID="3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc" exitCode=0
Jul 21 04:16:10.515251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.515144    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zbhwm"
Jul 21 04:16:10.515251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.515175    2578 scope.go:117] "RemoveContainer" containerID="3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc"
Jul 21 04:16:10.517156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.517031    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" containerName="manager" containerID="cri-o://3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58" gracePeriod=2
Jul 21 04:16:10.519324 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.519288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" event={"ID":"ba26bc24-8db3-4186-98b5-64f481efd76c","Type":"ContainerStarted","Data":"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"}
Jul 21 04:16:10.519421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.519338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" event={"ID":"ba26bc24-8db3-4186-98b5-64f481efd76c","Type":"ContainerStarted","Data":"3f282a46123c5c33faf3cfab15b8605b15ceef84131b61bd0e299ca2cc4227d4"}
Jul 21 04:16:10.519421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.519367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:10.520950 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.520932    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pnwnl"
Jul 21 04:16:10.523499 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.522830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7" event={"ID":"12124d16-9431-4949-b519-83c2b676865f","Type":"ContainerStarted","Data":"ce894aaa9582d6865c5beeb26a08daf6e492bd86b6a590022d07bbec2662f214"}
Jul 21 04:16:10.523499 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.522879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7" event={"ID":"12124d16-9431-4949-b519-83c2b676865f","Type":"ContainerStarted","Data":"58dccb88c2d58504ee1006cc8fba743b29ef0d1a372acb9271dcb5a56e671088"}
Jul 21 04:16:10.523499 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.523050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:10.525798 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.525776    2578 scope.go:117] "RemoveContainer" containerID="3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc"
Jul 21 04:16:10.526052 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:10.526032    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc\": container with ID starting with 3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc not found: ID does not exist" containerID="3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc"
Jul 21 04:16:10.526108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.526062    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc"} err="failed to get container status \"3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc\": rpc error: code = NotFound desc = could not find container \"3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc\": container with ID starting with 3f3deed751a7273c54301d353d88070475d3ebe86e106ec44b390755c93c51cc not found: ID does not exist"
Jul 21 04:16:10.526108 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.526080    2578 scope.go:117] "RemoveContainer" containerID="f7e1f36fe6af2cc93f5f68f90bba858db9766a7806926d7d3f3ddb7f7c92f4be"
Jul 21 04:16:10.564670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.564612    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" podStartSLOduration=1.564593933 podStartE2EDuration="1.564593933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:10.562655798 +0000 UTC m=+719.312706306" watchObservedRunningTime="2026-07-21 04:16:10.564593933 +0000 UTC m=+719.314644430"
Jul 21 04:16:10.593927 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.593863    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" podStartSLOduration=1.5938438910000001 podStartE2EDuration="1.593843891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:10.592103115 +0000 UTC m=+719.342153613" watchObservedRunningTime="2026-07-21 04:16:10.593843891 +0000 UTC m=+719.343894388"
Jul 21 04:16:10.610382 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.610335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7" podStartSLOduration=1.6103193980000001 podStartE2EDuration="1.610319398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:10.60948582 +0000 UTC m=+719.359536323" watchObservedRunningTime="2026-07-21 04:16:10.610319398 +0000 UTC m=+719.360369895"
Jul 21 04:16:10.775592 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.775526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:10.777503 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:10.777478    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:10.842000 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.841959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume\") pod \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") "
Jul 21 04:16:10.842174 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.842035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shpxj\" (UniqueName: \"kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj\") pod \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\" (UID: \"ca13413e-8a23-4d41-9ebf-f448d674f9b4\") "
Jul 21 04:16:10.842416 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.842391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca13413e-8a23-4d41-9ebf-f448d674f9b4" (UID: "ca13413e-8a23-4d41-9ebf-f448d674f9b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:16:10.844257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.844235    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj" (OuterVolumeSpecName: "kube-api-access-shpxj") pod "ca13413e-8a23-4d41-9ebf-f448d674f9b4" (UID: "ca13413e-8a23-4d41-9ebf-f448d674f9b4"). InnerVolumeSpecName "kube-api-access-shpxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:10.943509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.943477    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca13413e-8a23-4d41-9ebf-f448d674f9b4-extensions-socket-volume\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:10.943509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:10.943504    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shpxj\" (UniqueName: \"kubernetes.io/projected/ca13413e-8a23-4d41-9ebf-f448d674f9b4-kube-api-access-shpxj\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:11.529715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.529672    2578 generic.go:356] "Generic (PLEG): container finished" podID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" containerID="3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58" exitCode=0
Jul 21 04:16:11.529715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.529719    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:11.529981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.529770    2578 scope.go:117] "RemoveContainer" containerID="3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58"
Jul 21 04:16:11.531938 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:11.531899    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:11.539850 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.539826    2578 scope.go:117] "RemoveContainer" containerID="3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58"
Jul 21 04:16:11.540187 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:11.540157    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:11.540187 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:11.540177    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58\": container with ID starting with 3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58 not found: ID does not exist" containerID="3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58"
Jul 21 04:16:11.540398 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.540285    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58"} err="failed to get container status \"3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58\": rpc error: code = NotFound desc = could not find container \"3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58\": container with ID starting with 3beb7e998408e7de2edbe819b4447b27ce5c93863f18300824a2fa1cb7d20e58 not found: ID does not exist"
Jul 21 04:16:11.779419 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:11.779376    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-c5sfw\" is forbidden: User \"system:node:ip-10-0-135-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-112.ec2.internal' and this object" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-c5sfw"
Jul 21 04:16:11.781401 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:11.781341    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca13413e-8a23-4d41-9ebf-f448d674f9b4" path="/var/lib/kubelet/pods/ca13413e-8a23-4d41-9ebf-f448d674f9b4/volumes"
Jul 21 04:16:13.405740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:13.405691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:13.511743 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:13.511703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:15.594630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:15.594591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:15.694897 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:15.694861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:20.165120 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:20.165082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:20.294685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:20.294650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:21.532821 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.532792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:21.533302 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.532861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ks7b7"
Jul 21 04:16:21.533302 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.533008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:21.608653 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.608620    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:21.608833 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.608812    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" podUID="12b08d33-d1b1-4e90-a389-e899574130d3" containerName="manager" containerID="cri-o://89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7" gracePeriod=10
Jul 21 04:16:21.877806 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.877781    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:21.938490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.938452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume\") pod \"12b08d33-d1b1-4e90-a389-e899574130d3\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") "
Jul 21 04:16:21.938684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.938524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpgq7\" (UniqueName: \"kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7\") pod \"12b08d33-d1b1-4e90-a389-e899574130d3\" (UID: \"12b08d33-d1b1-4e90-a389-e899574130d3\") "
Jul 21 04:16:21.938761 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.938729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "12b08d33-d1b1-4e90-a389-e899574130d3" (UID: "12b08d33-d1b1-4e90-a389-e899574130d3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:16:21.941272 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:21.941242    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7" (OuterVolumeSpecName: "kube-api-access-wpgq7") pod "12b08d33-d1b1-4e90-a389-e899574130d3" (UID: "12b08d33-d1b1-4e90-a389-e899574130d3"). InnerVolumeSpecName "kube-api-access-wpgq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:22.039164 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.039136    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpgq7\" (UniqueName: \"kubernetes.io/projected/12b08d33-d1b1-4e90-a389-e899574130d3-kube-api-access-wpgq7\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:22.039164 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.039161    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12b08d33-d1b1-4e90-a389-e899574130d3-extensions-socket-volume\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:22.064014 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.063975    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:16:22.064403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.064390    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b08d33-d1b1-4e90-a389-e899574130d3" containerName="manager"
Jul 21 04:16:22.064456 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.064405    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b08d33-d1b1-4e90-a389-e899574130d3" containerName="manager"
Jul 21 04:16:22.064491 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.064459    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b08d33-d1b1-4e90-a389-e899574130d3" containerName="manager"
Jul 21 04:16:22.066369 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.066352    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.095589 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.095557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:16:22.140619 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.140530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.140619 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.140587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffwvt\" (UniqueName: \"kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.241791 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.241742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffwvt\" (UniqueName: \"kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.241976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.241868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.242313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.242295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.252225 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.252187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffwvt\" (UniqueName: \"kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt\") pod \"kuadrant-operator-controller-manager-86878c769f-l8lqp\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.376848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.376813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:22.527624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.527600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:16:22.529587 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:22.529556    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4369fa65_4051_4f03_ab53_06e63e073bc3.slice/crio-5fe0862e7369dc3bd5fd77ce24661ca56da6345489f9d69a54e6901a504bf7ec WatchSource:0}: Error finding container 5fe0862e7369dc3bd5fd77ce24661ca56da6345489f9d69a54e6901a504bf7ec: Status 404 returned error can't find the container with id 5fe0862e7369dc3bd5fd77ce24661ca56da6345489f9d69a54e6901a504bf7ec
Jul 21 04:16:22.587076 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.587042    2578 generic.go:356] "Generic (PLEG): container finished" podID="12b08d33-d1b1-4e90-a389-e899574130d3" containerID="89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7" exitCode=0
Jul 21 04:16:22.587509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.587115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"
Jul 21 04:16:22.587509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.587124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" event={"ID":"12b08d33-d1b1-4e90-a389-e899574130d3","Type":"ContainerDied","Data":"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"}
Jul 21 04:16:22.587509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.587190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj" event={"ID":"12b08d33-d1b1-4e90-a389-e899574130d3","Type":"ContainerDied","Data":"013cda1cb0f71c4b430ee92753431a28f7c16d78da26ec828b762a369d240b98"}
Jul 21 04:16:22.587509 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.587248    2578 scope.go:117] "RemoveContainer" containerID="89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"
Jul 21 04:16:22.588941 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.588906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" event={"ID":"4369fa65-4051-4f03-ab53-06e63e073bc3","Type":"ContainerStarted","Data":"5fe0862e7369dc3bd5fd77ce24661ca56da6345489f9d69a54e6901a504bf7ec"}
Jul 21 04:16:22.599036 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.599014    2578 scope.go:117] "RemoveContainer" containerID="89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"
Jul 21 04:16:22.599440 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:22.599410    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7\": container with ID starting with 89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7 not found: ID does not exist" containerID="89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"
Jul 21 04:16:22.599572 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.599477    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7"} err="failed to get container status \"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7\": rpc error: code = NotFound desc = could not find container \"89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7\": container with ID starting with 89340d0a809bf6405fb2c13967d79b395ebd6db33e0753d047a6260b7d9817a7 not found: ID does not exist"
Jul 21 04:16:22.617333 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.617301    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:22.623313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:22.623285    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dfgwj"]
Jul 21 04:16:23.596565 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:23.596525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" event={"ID":"4369fa65-4051-4f03-ab53-06e63e073bc3","Type":"ContainerStarted","Data":"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"}
Jul 21 04:16:23.597035 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:23.596689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:23.617873 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:23.617816    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" podStartSLOduration=1.617800333 podStartE2EDuration="1.617800333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:23.616338575 +0000 UTC m=+732.366389068" watchObservedRunningTime="2026-07-21 04:16:23.617800333 +0000 UTC m=+732.367850829"
Jul 21 04:16:23.781781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:23.781744    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b08d33-d1b1-4e90-a389-e899574130d3" path="/var/lib/kubelet/pods/12b08d33-d1b1-4e90-a389-e899574130d3/volumes"
Jul 21 04:16:23.999193 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:23.999147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:34.604155 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:34.604123    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:16:34.661613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:34.661575    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:34.661821 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:34.661797    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" podUID="ba26bc24-8db3-4186-98b5-64f481efd76c" containerName="manager" containerID="cri-o://37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14" gracePeriod=10
Jul 21 04:16:34.917550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:34.917526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:35.063328 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.063284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume\") pod \"ba26bc24-8db3-4186-98b5-64f481efd76c\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") "
Jul 21 04:16:35.063532 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.063337    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n7vc\" (UniqueName: \"kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc\") pod \"ba26bc24-8db3-4186-98b5-64f481efd76c\" (UID: \"ba26bc24-8db3-4186-98b5-64f481efd76c\") "
Jul 21 04:16:35.063678 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.063649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba26bc24-8db3-4186-98b5-64f481efd76c" (UID: "ba26bc24-8db3-4186-98b5-64f481efd76c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:16:35.065673 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.065648    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc" (OuterVolumeSpecName: "kube-api-access-8n7vc") pod "ba26bc24-8db3-4186-98b5-64f481efd76c" (UID: "ba26bc24-8db3-4186-98b5-64f481efd76c"). InnerVolumeSpecName "kube-api-access-8n7vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:35.164538 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.164504    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba26bc24-8db3-4186-98b5-64f481efd76c-extensions-socket-volume\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:35.164538 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.164536    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n7vc\" (UniqueName: \"kubernetes.io/projected/ba26bc24-8db3-4186-98b5-64f481efd76c-kube-api-access-8n7vc\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:16:35.658330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.658295    2578 generic.go:356] "Generic (PLEG): container finished" podID="ba26bc24-8db3-4186-98b5-64f481efd76c" containerID="37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14" exitCode=0
Jul 21 04:16:35.658330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.658334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" event={"ID":"ba26bc24-8db3-4186-98b5-64f481efd76c","Type":"ContainerDied","Data":"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"}
Jul 21 04:16:35.658776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.658345    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"
Jul 21 04:16:35.658776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.658378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l" event={"ID":"ba26bc24-8db3-4186-98b5-64f481efd76c","Type":"ContainerDied","Data":"3f282a46123c5c33faf3cfab15b8605b15ceef84131b61bd0e299ca2cc4227d4"}
Jul 21 04:16:35.658776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.658400    2578 scope.go:117] "RemoveContainer" containerID="37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"
Jul 21 04:16:35.668411 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.668235    2578 scope.go:117] "RemoveContainer" containerID="37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"
Jul 21 04:16:35.668574 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:16:35.668554    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14\": container with ID starting with 37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14 not found: ID does not exist" containerID="37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"
Jul 21 04:16:35.668614 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.668585    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14"} err="failed to get container status \"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14\": rpc error: code = NotFound desc = could not find container \"37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14\": container with ID starting with 37bea483d17cd6a6f9e2adc36831b4e7fa1be1434649c2d7844dd1356f622f14 not found: ID does not exist"
Jul 21 04:16:35.690953 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.690916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:35.708733 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.708694    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d646l"]
Jul 21 04:16:35.780712 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:35.780676    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba26bc24-8db3-4186-98b5-64f481efd76c" path="/var/lib/kubelet/pods/ba26bc24-8db3-4186-98b5-64f481efd76c/volumes"
Jul 21 04:16:38.232048 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.232007    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"]
Jul 21 04:16:38.232458 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.232443    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba26bc24-8db3-4186-98b5-64f481efd76c" containerName="manager"
Jul 21 04:16:38.232505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.232460    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba26bc24-8db3-4186-98b5-64f481efd76c" containerName="manager"
Jul 21 04:16:38.232554 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.232538    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba26bc24-8db3-4186-98b5-64f481efd76c" containerName="manager"
Jul 21 04:16:38.235701 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.235679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.238286 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.238264    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 04:16:38.238553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.238540    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dsrkn\""
Jul 21 04:16:38.248945 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.248921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"]
Jul 21 04:16:38.258801 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.258774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:38.393905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.393860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6278cca9-031b-4f29-aac3-e3a063643532-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.393905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.393913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.393937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.393954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6278cca9-031b-4f29-aac3-e3a063643532-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.394061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnbn\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-kube-api-access-zcnbn\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.394079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.394094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.394116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.394132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.394132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6278cca9-031b-4f29-aac3-e3a063643532-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnbn\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-kube-api-access-zcnbn\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6278cca9-031b-4f29-aac3-e3a063643532-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.495676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.496029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.496029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.495972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.496029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.496013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.496413 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.496389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.496524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.496465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6278cca9-031b-4f29-aac3-e3a063643532-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.497938 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.497916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6278cca9-031b-4f29-aac3-e3a063643532-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.498068 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.498049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6278cca9-031b-4f29-aac3-e3a063643532-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.504561 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.504532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.504750 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.504723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnbn\" (UniqueName: \"kubernetes.io/projected/6278cca9-031b-4f29-aac3-e3a063643532-kube-api-access-zcnbn\") pod \"maas-default-gateway-openshift-default-56654dcf7-bz5xc\" (UID: \"6278cca9-031b-4f29-aac3-e3a063643532\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.546384 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.546333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:38.635647 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.635618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:38.687955 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:38.687922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"]
Jul 21 04:16:38.691678 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:38.691647    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6278cca9_031b_4f29_aac3_e3a063643532.slice/crio-36d4f4405cce8a96db57e1cd0216b7216e0630e8465471bc52daa472680f8508 WatchSource:0}: Error finding container 36d4f4405cce8a96db57e1cd0216b7216e0630e8465471bc52daa472680f8508: Status 404 returned error can't find the container with id 36d4f4405cce8a96db57e1cd0216b7216e0630e8465471bc52daa472680f8508
Jul 21 04:16:39.687495 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:39.687449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" event={"ID":"6278cca9-031b-4f29-aac3-e3a063643532","Type":"ContainerStarted","Data":"36d4f4405cce8a96db57e1cd0216b7216e0630e8465471bc52daa472680f8508"}
Jul 21 04:16:41.502397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:41.502362    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:16:41.502652 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:41.502446    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:16:41.502652 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:41.502480    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:16:41.700685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:41.700650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" event={"ID":"6278cca9-031b-4f29-aac3-e3a063643532","Type":"ContainerStarted","Data":"c4d012ed61df346c50585e97b37c4b1baf95b7fcc56012b4684926929a883b24"}
Jul 21 04:16:41.722337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:41.722282    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" podStartSLOduration=0.913911354 podStartE2EDuration="3.722265024s" totalImagesPullingTime="2.80835367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:41.720834073 +0000 UTC m=+750.470884570" watchObservedRunningTime="2026-07-21 04:16:41.722265024 +0000 UTC m=+750.472315521"
Jul 21 04:16:42.547297 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:42.547253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:42.552583 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:42.552554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:42.705561 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:42.705527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:42.706359 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:42.706338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:16:53.452001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.451956    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:16:53.452676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.452644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:53.455786 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.455768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.458031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.458005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 04:16:53.458144 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.458128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq5dx\""
Jul 21 04:16:53.462332 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.462307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:16:53.517186 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.517124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.517186 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.517187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckcs\" (UniqueName: \"kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.553510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.553468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:53.554877 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.554852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:16:53.618062 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.618037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.618206 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.618074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckcs\" (UniqueName: \"kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.618656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.618637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.626581 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.626558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckcs\" (UniqueName: \"kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs\") pod \"limitador-limitador-64c94fd64f-p7vgm\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.651529 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.651451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:53.767696 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.767614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:53.906622 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:53.906600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:16:53.908724 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:53.908694    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2857900_925e_45d3_8a7d_ff202fd0179a.slice/crio-b0c99a03701c23c01f0b7004466fba59410aa254ef2d37a728916b18130be238 WatchSource:0}: Error finding container b0c99a03701c23c01f0b7004466fba59410aa254ef2d37a728916b18130be238: Status 404 returned error can't find the container with id b0c99a03701c23c01f0b7004466fba59410aa254ef2d37a728916b18130be238
Jul 21 04:16:54.244014 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.243971    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:16:54.249091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.249067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:16:54.251387 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.251363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-htl9d\""
Jul 21 04:16:54.254083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.254064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:16:54.270425 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.270396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:54.324058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.324031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqv8\" (UniqueName: \"kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8\") pod \"authorino-58cd955675-f5md4\" (UID: \"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce\") " pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:16:54.327565 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.327536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:54.424847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.424796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqv8\" (UniqueName: \"kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8\") pod \"authorino-58cd955675-f5md4\" (UID: \"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce\") " pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:16:54.432986 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.432960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqv8\" (UniqueName: \"kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8\") pod \"authorino-58cd955675-f5md4\" (UID: \"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce\") " pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:16:54.435500 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.435471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:54.536134 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.536055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:16:54.560059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.560030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:16:54.717059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.717023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:16:54.721039 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:16:54.721008    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea2a4f10_e4fe_448c_8de5_30ae6124b3ce.slice/crio-a2bf1dea81a7b1a9b136be1a1a6e0d8b7a6a75a316b6233470b8e8743814d9d2 WatchSource:0}: Error finding container a2bf1dea81a7b1a9b136be1a1a6e0d8b7a6a75a316b6233470b8e8743814d9d2: Status 404 returned error can't find the container with id a2bf1dea81a7b1a9b136be1a1a6e0d8b7a6a75a316b6233470b8e8743814d9d2
Jul 21 04:16:54.769257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.769206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5md4" event={"ID":"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce","Type":"ContainerStarted","Data":"a2bf1dea81a7b1a9b136be1a1a6e0d8b7a6a75a316b6233470b8e8743814d9d2"}
Jul 21 04:16:54.770961 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:54.770931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" event={"ID":"e2857900-925e-45d3-8a7d-ff202fd0179a","Type":"ContainerStarted","Data":"b0c99a03701c23c01f0b7004466fba59410aa254ef2d37a728916b18130be238"}
Jul 21 04:16:58.796549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.796509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5md4" event={"ID":"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce","Type":"ContainerStarted","Data":"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"}
Jul 21 04:16:58.798120 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.798092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" event={"ID":"e2857900-925e-45d3-8a7d-ff202fd0179a","Type":"ContainerStarted","Data":"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"}
Jul 21 04:16:58.798292 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.798179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:16:58.810371 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.810327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f5md4" podStartSLOduration=0.91850422 podStartE2EDuration="4.810313044s" totalImagesPullingTime="3.891808824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:58.809123937 +0000 UTC m=+767.559174435" watchObservedRunningTime="2026-07-21 04:16:58.810313044 +0000 UTC m=+767.560363540"
Jul 21 04:16:58.827196 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.827146    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" podStartSLOduration=1.129714609 podStartE2EDuration="5.827128158s" totalImagesPullingTime="4.697413549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:58.825080339 +0000 UTC m=+767.575130837" watchObservedRunningTime="2026-07-21 04:16:58.827128158 +0000 UTC m=+767.577178712"
Jul 21 04:16:58.874701 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:16:58.874572    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:17:00.807757 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:00.807716    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f5md4" podUID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" containerName="authorino" containerID="cri-o://cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b" gracePeriod=30
Jul 21 04:17:01.060520 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.060456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:17:01.185074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.185032    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cqv8\" (UniqueName: \"kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8\") pod \"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce\" (UID: \"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce\") "
Jul 21 04:17:01.187315 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.187292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8" (OuterVolumeSpecName: "kube-api-access-5cqv8") pod "ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" (UID: "ea2a4f10-e4fe-448c-8de5-30ae6124b3ce"). InnerVolumeSpecName "kube-api-access-5cqv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:01.286422 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.286392    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cqv8\" (UniqueName: \"kubernetes.io/projected/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce-kube-api-access-5cqv8\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:01.813693 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.813655    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" containerID="cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b" exitCode=0
Jul 21 04:17:01.813693 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.813690    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5md4"
Jul 21 04:17:01.814117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.813735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5md4" event={"ID":"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce","Type":"ContainerDied","Data":"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"}
Jul 21 04:17:01.814117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.813773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5md4" event={"ID":"ea2a4f10-e4fe-448c-8de5-30ae6124b3ce","Type":"ContainerDied","Data":"a2bf1dea81a7b1a9b136be1a1a6e0d8b7a6a75a316b6233470b8e8743814d9d2"}
Jul 21 04:17:01.814117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.813793    2578 scope.go:117] "RemoveContainer" containerID="cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"
Jul 21 04:17:01.824470 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.824447    2578 scope.go:117] "RemoveContainer" containerID="cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"
Jul 21 04:17:01.824770 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:01.824750    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b\": container with ID starting with cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b not found: ID does not exist" containerID="cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"
Jul 21 04:17:01.824853 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.824781    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b"} err="failed to get container status \"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b\": rpc error: code = NotFound desc = could not find container \"cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b\": container with ID starting with cc0917cc533987c7badd143f188256919e48f7e67238f42a72afe523ae95284b not found: ID does not exist"
Jul 21 04:17:01.831852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.831830    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:17:01.835966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:01.835942    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5md4"]
Jul 21 04:17:03.781094 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:03.781065    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" path="/var/lib/kubelet/pods/ea2a4f10-e4fe-448c-8de5-30ae6124b3ce/volumes"
Jul 21 04:17:08.889613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:08.889573    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:17:08.890163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:08.889776    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" podUID="e2857900-925e-45d3-8a7d-ff202fd0179a" containerName="limitador" containerID="cri-o://c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e" gracePeriod=30
Jul 21 04:17:08.890803 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:08.890779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:17:09.466160 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.466136    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:17:09.563909 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.563876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mckcs\" (UniqueName: \"kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs\") pod \"e2857900-925e-45d3-8a7d-ff202fd0179a\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") "
Jul 21 04:17:09.564074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.563983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file\") pod \"e2857900-925e-45d3-8a7d-ff202fd0179a\" (UID: \"e2857900-925e-45d3-8a7d-ff202fd0179a\") "
Jul 21 04:17:09.564360 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.564338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file" (OuterVolumeSpecName: "config-file") pod "e2857900-925e-45d3-8a7d-ff202fd0179a" (UID: "e2857900-925e-45d3-8a7d-ff202fd0179a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:17:09.566122 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.566104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs" (OuterVolumeSpecName: "kube-api-access-mckcs") pod "e2857900-925e-45d3-8a7d-ff202fd0179a" (UID: "e2857900-925e-45d3-8a7d-ff202fd0179a"). InnerVolumeSpecName "kube-api-access-mckcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:09.665630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.665591    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2857900-925e-45d3-8a7d-ff202fd0179a-config-file\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:09.665630 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.665623    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mckcs\" (UniqueName: \"kubernetes.io/projected/e2857900-925e-45d3-8a7d-ff202fd0179a-kube-api-access-mckcs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:09.866296 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.866246    2578 generic.go:356] "Generic (PLEG): container finished" podID="e2857900-925e-45d3-8a7d-ff202fd0179a" containerID="c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e" exitCode=0
Jul 21 04:17:09.866494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.866309    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"
Jul 21 04:17:09.866494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.866299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" event={"ID":"e2857900-925e-45d3-8a7d-ff202fd0179a","Type":"ContainerDied","Data":"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"}
Jul 21 04:17:09.866593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.866521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p7vgm" event={"ID":"e2857900-925e-45d3-8a7d-ff202fd0179a","Type":"ContainerDied","Data":"b0c99a03701c23c01f0b7004466fba59410aa254ef2d37a728916b18130be238"}
Jul 21 04:17:09.866593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.866570    2578 scope.go:117] "RemoveContainer" containerID="c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"
Jul 21 04:17:09.875457 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.875439    2578 scope.go:117] "RemoveContainer" containerID="c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"
Jul 21 04:17:09.875717 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:09.875697    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e\": container with ID starting with c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e not found: ID does not exist" containerID="c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"
Jul 21 04:17:09.875770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.875727    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e"} err="failed to get container status \"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e\": rpc error: code = NotFound desc = could not find container \"c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e\": container with ID starting with c364bbf39fe410bfe03c8a8be44640393a8cb03a6d3fbf69597cdbb2e210c40e not found: ID does not exist"
Jul 21 04:17:09.882939 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.882913    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:17:09.884503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:09.884477    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p7vgm"]
Jul 21 04:17:11.780383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:11.780354    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2857900-925e-45d3-8a7d-ff202fd0179a" path="/var/lib/kubelet/pods/e2857900-925e-45d3-8a7d-ff202fd0179a/volumes"
Jul 21 04:17:14.490139 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.490100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:14.589633 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.589592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:14.987907 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.987861    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"]
Jul 21 04:17:14.988487 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988467    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" containerName="authorino"
Jul 21 04:17:14.988595 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988489    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" containerName="authorino"
Jul 21 04:17:14.988595 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988525    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2857900-925e-45d3-8a7d-ff202fd0179a" containerName="limitador"
Jul 21 04:17:14.988595 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988534    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2857900-925e-45d3-8a7d-ff202fd0179a" containerName="limitador"
Jul 21 04:17:14.988744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2a4f10-e4fe-448c-8de5-30ae6124b3ce" containerName="authorino"
Jul 21 04:17:14.988744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.988643    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2857900-925e-45d3-8a7d-ff202fd0179a" containerName="limitador"
Jul 21 04:17:14.997505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.997478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:14.999590 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:14.999565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"]
Jul 21 04:17:15.000156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.000136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-s29vn\""
Jul 21 04:17:15.001004 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.000983    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 04:17:15.001428 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.000994    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 04:17:15.001428 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.001128    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:17:15.018439 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.018411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:15.116387 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.116358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9fcf23d-ee1c-42ea-88da-efa0c66457df-data\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.116550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.116401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgld4\" (UniqueName: \"kubernetes.io/projected/c9fcf23d-ee1c-42ea-88da-efa0c66457df-kube-api-access-jgld4\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.217715 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.217675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9fcf23d-ee1c-42ea-88da-efa0c66457df-data\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.217875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.217724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgld4\" (UniqueName: \"kubernetes.io/projected/c9fcf23d-ee1c-42ea-88da-efa0c66457df-kube-api-access-jgld4\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.218119 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.218098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9fcf23d-ee1c-42ea-88da-efa0c66457df-data\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.226296 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.226268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgld4\" (UniqueName: \"kubernetes.io/projected/c9fcf23d-ee1c-42ea-88da-efa0c66457df-kube-api-access-jgld4\") pod \"postgres-69fb4594cf-fgnnb\" (UID: \"c9fcf23d-ee1c-42ea-88da-efa0c66457df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.310035 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.309953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:15.444180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.444160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"]
Jul 21 04:17:15.446097 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:17:15.446069    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fcf23d_ee1c_42ea_88da_efa0c66457df.slice/crio-132abb75852a8c1679050f6514252f786751fb886de700663dc1d0752aa4c1c0 WatchSource:0}: Error finding container 132abb75852a8c1679050f6514252f786751fb886de700663dc1d0752aa4c1c0: Status 404 returned error can't find the container with id 132abb75852a8c1679050f6514252f786751fb886de700663dc1d0752aa4c1c0
Jul 21 04:17:15.897474 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:15.897440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb" event={"ID":"c9fcf23d-ee1c-42ea-88da-efa0c66457df","Type":"ContainerStarted","Data":"132abb75852a8c1679050f6514252f786751fb886de700663dc1d0752aa4c1c0"}
Jul 21 04:17:20.926629 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:20.926585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb" event={"ID":"c9fcf23d-ee1c-42ea-88da-efa0c66457df","Type":"ContainerStarted","Data":"cfa084670f8779c60d5bc4a0eddd73a7b5850eb3b8454e03d739a729eb02865f"}
Jul 21 04:17:20.927087 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:20.926708    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:20.943232 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:20.943166    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb" podStartSLOduration=2.039835088 podStartE2EDuration="6.943150148s" totalImagesPullingTime="4.90331506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:20.942495591 +0000 UTC m=+789.692546089" watchObservedRunningTime="2026-07-21 04:17:20.943150148 +0000 UTC m=+789.693200644"
Jul 21 04:17:26.961329 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:26.961296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgnnb"
Jul 21 04:17:27.467190 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.467158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:27.568364 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.568318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:27.711923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.711889    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nrfzq"]
Jul 21 04:17:27.718031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.717969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.720378 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.720359    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-htl9d\""
Jul 21 04:17:27.721086 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.721068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nrfzq"]
Jul 21 04:17:27.836859 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.836828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8x4q\" (UniqueName: \"kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q\") pod \"authorino-5d4b67c446-nrfzq\" (UID: \"debfccab-001f-4cc4-b89e-79351417025b\") " pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.938122 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.938075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8x4q\" (UniqueName: \"kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q\") pod \"authorino-5d4b67c446-nrfzq\" (UID: \"debfccab-001f-4cc4-b89e-79351417025b\") " pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.939814 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.939791    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nrfzq"]
Jul 21 04:17:27.940014 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:27.939997    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-p8x4q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nrfzq" podUID="debfccab-001f-4cc4-b89e-79351417025b"
Jul 21 04:17:27.948990 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.948966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8x4q\" (UniqueName: \"kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q\") pod \"authorino-5d4b67c446-nrfzq\" (UID: \"debfccab-001f-4cc4-b89e-79351417025b\") " pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.959059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.959033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.966303 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.966282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:27.966987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.966966    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-2nt4t"]
Jul 21 04:17:27.970647 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.970599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:27.974315 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.974298    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 04:17:27.980350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:27.980327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-2nt4t"]
Jul 21 04:17:28.002181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.002150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2nt4t"]
Jul 21 04:17:28.002449 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:28.002431    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kcgh9 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-kcgh9 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-2nt4t" podUID="0398f39f-2e39-4e14-bbfe-3db5e488a47c"
Jul 21 04:17:28.038737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.038705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.038918 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.038758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.139609 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.139578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8x4q\" (UniqueName: \"kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q\") pod \"debfccab-001f-4cc4-b89e-79351417025b\" (UID: \"debfccab-001f-4cc4-b89e-79351417025b\") "
Jul 21 04:17:28.139773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.139712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.139773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.139757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.141727 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.141698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q" (OuterVolumeSpecName: "kube-api-access-p8x4q") pod "debfccab-001f-4cc4-b89e-79351417025b" (UID: "debfccab-001f-4cc4-b89e-79351417025b"). InnerVolumeSpecName "kube-api-access-p8x4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:28.142253 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.142230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.148316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.148297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9\") pod \"authorino-76877994-2nt4t\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") " pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:28.240464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.240393    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8x4q\" (UniqueName: \"kubernetes.io/projected/debfccab-001f-4cc4-b89e-79351417025b-kube-api-access-p8x4q\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:28.963941 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.963908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nrfzq"
Jul 21 04:17:28.964151 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:28.963908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:29.026135 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.026103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:29.045358 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.045327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert\") pod \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") "
Jul 21 04:17:29.045543 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.045405    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9\") pod \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\" (UID: \"0398f39f-2e39-4e14-bbfe-3db5e488a47c\") "
Jul 21 04:17:29.048267 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.048196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9" (OuterVolumeSpecName: "kube-api-access-kcgh9") pod "0398f39f-2e39-4e14-bbfe-3db5e488a47c" (UID: "0398f39f-2e39-4e14-bbfe-3db5e488a47c"). InnerVolumeSpecName "kube-api-access-kcgh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:29.048544 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.048518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0398f39f-2e39-4e14-bbfe-3db5e488a47c" (UID: "0398f39f-2e39-4e14-bbfe-3db5e488a47c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:17:29.052172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.052145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nrfzq"]
Jul 21 04:17:29.062089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.062062    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nrfzq"]
Jul 21 04:17:29.146466 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.146440    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0398f39f-2e39-4e14-bbfe-3db5e488a47c-tls-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:29.146466 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.146464    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/0398f39f-2e39-4e14-bbfe-3db5e488a47c-kube-api-access-kcgh9\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:29.780999 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.780965    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="debfccab-001f-4cc4-b89e-79351417025b" path="/var/lib/kubelet/pods/debfccab-001f-4cc4-b89e-79351417025b/volumes"
Jul 21 04:17:29.968834 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.968801    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2nt4t"
Jul 21 04:17:29.995392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.995361    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2nt4t"]
Jul 21 04:17:29.999058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:29.999034    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-2nt4t"]
Jul 21 04:17:31.780763 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:31.780733    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0398f39f-2e39-4e14-bbfe-3db5e488a47c" path="/var/lib/kubelet/pods/0398f39f-2e39-4e14-bbfe-3db5e488a47c/volumes"
Jul 21 04:17:34.133824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.133735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:34.143287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.143259    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:34.161581 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.161537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:34.161781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.161643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.164417 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.164393    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 04:17:34.164588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.164434    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 04:17:34.164588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.164539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kktkq\""
Jul 21 04:17:34.181772 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.181747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5t7\" (UniqueName: \"kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.181886 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.181783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.233105 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.233070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:34.283018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.282988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5t7\" (UniqueName: \"kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.283018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.283023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.283243 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:34.283155    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 04:17:34.283243 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:34.283234    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert podName:eeca345c-2525-48f8-80d2-c6668e51a0c3 nodeName:}" failed. No retries permitted until 2026-07-21 04:17:34.783200006 +0000 UTC m=+803.533250485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert") pod "maas-controller-76b4f6b785-v7zc9" (UID: "eeca345c-2525-48f8-80d2-c6668e51a0c3") : secret "maas-controller-webhook-cert" not found
Jul 21 04:17:34.294287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.294253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5t7\" (UniqueName: \"kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.333264 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.333200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:34.336867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.336839    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:17:34.339407 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.339380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.350991 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.350966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:17:34.384009 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.383942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.384009 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.384006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2pzw\" (UniqueName: \"kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.485068 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.485018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.485251 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.485130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2pzw\" (UniqueName: \"kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.485251 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:34.485143    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 04:17:34.485251 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:34.485227    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert podName:eddc9d32-bfc4-49a9-9067-fd86aca73fd8 nodeName:}" failed. No retries permitted until 2026-07-21 04:17:34.985192812 +0000 UTC m=+803.735243287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert") pod "maas-controller-7c9f7f6f8c-dm4gv" (UID: "eddc9d32-bfc4-49a9-9067-fd86aca73fd8") : secret "maas-controller-webhook-cert" not found
Jul 21 04:17:34.493864 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.493832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2pzw\" (UniqueName: \"kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.569401 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.569365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:34.787163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.787129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.789716 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.789693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") pod \"maas-controller-76b4f6b785-v7zc9\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") " pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:34.988163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.988117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:34.990709 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:34.990686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-dm4gv\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") " pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:35.072639 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:35.072566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:35.204047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:35.204023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:35.206045 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:17:35.206016    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeca345c_2525_48f8_80d2_c6668e51a0c3.slice/crio-44269ce61d50510d82d881a645c733dd004da0964ee0f24cdd5183b72990c16b WatchSource:0}: Error finding container 44269ce61d50510d82d881a645c733dd004da0964ee0f24cdd5183b72990c16b: Status 404 returned error can't find the container with id 44269ce61d50510d82d881a645c733dd004da0964ee0f24cdd5183b72990c16b
Jul 21 04:17:35.250662 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:35.250635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:35.385003 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:35.384979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:17:35.387531 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:17:35.387501    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddc9d32_bfc4_49a9_9067_fd86aca73fd8.slice/crio-7cf6461b13125f74b71039935200bf1c5364ff5e1afd4122f3dbfe6ee7688b4c WatchSource:0}: Error finding container 7cf6461b13125f74b71039935200bf1c5364ff5e1afd4122f3dbfe6ee7688b4c: Status 404 returned error can't find the container with id 7cf6461b13125f74b71039935200bf1c5364ff5e1afd4122f3dbfe6ee7688b4c
Jul 21 04:17:36.002077 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:36.002034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" event={"ID":"eddc9d32-bfc4-49a9-9067-fd86aca73fd8","Type":"ContainerStarted","Data":"7cf6461b13125f74b71039935200bf1c5364ff5e1afd4122f3dbfe6ee7688b4c"}
Jul 21 04:17:36.003659 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:36.003605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" event={"ID":"eeca345c-2525-48f8-80d2-c6668e51a0c3","Type":"ContainerStarted","Data":"44269ce61d50510d82d881a645c733dd004da0964ee0f24cdd5183b72990c16b"}
Jul 21 04:17:38.138129 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:38.138094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:38.231421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:38.231294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:17:39.020769 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.020735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" event={"ID":"eeca345c-2525-48f8-80d2-c6668e51a0c3","Type":"ContainerStarted","Data":"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"}
Jul 21 04:17:39.021011 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.020884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:39.022147 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.022117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" event={"ID":"eddc9d32-bfc4-49a9-9067-fd86aca73fd8","Type":"ContainerStarted","Data":"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"}
Jul 21 04:17:39.022277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.022176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:39.038157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.038115    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" podStartSLOduration=2.29467482 podStartE2EDuration="5.038100867s" totalImagesPullingTime="2.743426047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:39.037322617 +0000 UTC m=+807.787373129" watchObservedRunningTime="2026-07-21 04:17:39.038100867 +0000 UTC m=+807.788151385"
Jul 21 04:17:39.055419 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:39.055375    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" podStartSLOduration=2.486603616 podStartE2EDuration="5.055361287s" totalImagesPullingTime="2.568757671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:39.054351396 +0000 UTC m=+807.804401892" watchObservedRunningTime="2026-07-21 04:17:39.055361287 +0000 UTC m=+807.805411784"
Jul 21 04:17:50.030070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.030027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:50.030472 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.030116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:17:50.094964 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.094925    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:50.095344 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.095189    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" podUID="eeca345c-2525-48f8-80d2-c6668e51a0c3" containerName="manager" containerID="cri-o://c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f" gracePeriod=30
Jul 21 04:17:50.357522 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.357499    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:50.438483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.438448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r5t7\" (UniqueName: \"kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7\") pod \"eeca345c-2525-48f8-80d2-c6668e51a0c3\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") "
Jul 21 04:17:50.438654 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.438491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") pod \"eeca345c-2525-48f8-80d2-c6668e51a0c3\" (UID: \"eeca345c-2525-48f8-80d2-c6668e51a0c3\") "
Jul 21 04:17:50.440876 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.440846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eeca345c-2525-48f8-80d2-c6668e51a0c3" (UID: "eeca345c-2525-48f8-80d2-c6668e51a0c3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:17:50.441093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.441067    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7" (OuterVolumeSpecName: "kube-api-access-8r5t7") pod "eeca345c-2525-48f8-80d2-c6668e51a0c3" (UID: "eeca345c-2525-48f8-80d2-c6668e51a0c3"). InnerVolumeSpecName "kube-api-access-8r5t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:50.539679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.539645    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r5t7\" (UniqueName: \"kubernetes.io/projected/eeca345c-2525-48f8-80d2-c6668e51a0c3-kube-api-access-8r5t7\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:50.539679 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:50.539676    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeca345c-2525-48f8-80d2-c6668e51a0c3-webhook-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:17:51.091199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.091164    2578 generic.go:356] "Generic (PLEG): container finished" podID="eeca345c-2525-48f8-80d2-c6668e51a0c3" containerID="c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f" exitCode=0
Jul 21 04:17:51.091612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.091223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b4f6b785-v7zc9"
Jul 21 04:17:51.091612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.091247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" event={"ID":"eeca345c-2525-48f8-80d2-c6668e51a0c3","Type":"ContainerDied","Data":"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"}
Jul 21 04:17:51.091612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.091301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b4f6b785-v7zc9" event={"ID":"eeca345c-2525-48f8-80d2-c6668e51a0c3","Type":"ContainerDied","Data":"44269ce61d50510d82d881a645c733dd004da0964ee0f24cdd5183b72990c16b"}
Jul 21 04:17:51.091612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.091323    2578 scope.go:117] "RemoveContainer" containerID="c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"
Jul 21 04:17:51.100740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.100556    2578 scope.go:117] "RemoveContainer" containerID="c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"
Jul 21 04:17:51.100835 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:17:51.100819    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f\": container with ID starting with c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f not found: ID does not exist" containerID="c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"
Jul 21 04:17:51.100875 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.100843    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f"} err="failed to get container status \"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f\": rpc error: code = NotFound desc = could not find container \"c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f\": container with ID starting with c667df7a70e1bc22c8b1052acd7ac94a9dac1cd4f1892539c5e69b7faab9ec6f not found: ID does not exist"
Jul 21 04:17:51.112658 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.112633    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:51.115692 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.115670    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76b4f6b785-v7zc9"]
Jul 21 04:17:51.780574 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:51.780545    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeca345c-2525-48f8-80d2-c6668e51a0c3" path="/var/lib/kubelet/pods/eeca345c-2525-48f8-80d2-c6668e51a0c3/volumes"
Jul 21 04:17:55.880346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:17:55.880291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:01.072898 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:01.072857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:01.138056 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:01.138022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:10.911183 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:10.911138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:11.003382 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:11.003344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:11.515752 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:11.515717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:11.694061 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:11.694016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:12.176817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.176774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:12.271532 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.271493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:12.278129 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.278106    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kswpp"]
Jul 21 04:18:12.278505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.278493    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeca345c-2525-48f8-80d2-c6668e51a0c3" containerName="manager"
Jul 21 04:18:12.278552 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.278507    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeca345c-2525-48f8-80d2-c6668e51a0c3" containerName="manager"
Jul 21 04:18:12.278587 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.278566    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeca345c-2525-48f8-80d2-c6668e51a0c3" containerName="manager"
Jul 21 04:18:12.286393 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.286371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.289571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.288868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 04:18:12.290411 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.290390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kswpp"]
Jul 21 04:18:12.299893 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.299867    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6b6qh"]
Jul 21 04:18:12.303733 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.303710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.306461 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.306438    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qqwz4\""
Jul 21 04:18:12.317735 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.317709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6b6qh"]
Jul 21 04:18:12.445083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.444986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d759e102-32f6-492a-87c8-b9b8646958cf-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.445083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.445030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9695944-58fc-4a14-a192-5c3586c19e76-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.445083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.445047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2bmz\" (UniqueName: \"kubernetes.io/projected/e9695944-58fc-4a14-a192-5c3586c19e76-kube-api-access-n2bmz\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.445083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.445067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kdh\" (UniqueName: \"kubernetes.io/projected/d759e102-32f6-492a-87c8-b9b8646958cf-kube-api-access-v5kdh\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.546362 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.546323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9695944-58fc-4a14-a192-5c3586c19e76-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.546362 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.546360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2bmz\" (UniqueName: \"kubernetes.io/projected/e9695944-58fc-4a14-a192-5c3586c19e76-kube-api-access-n2bmz\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.546626 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.546392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kdh\" (UniqueName: \"kubernetes.io/projected/d759e102-32f6-492a-87c8-b9b8646958cf-kube-api-access-v5kdh\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.546626 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.546518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d759e102-32f6-492a-87c8-b9b8646958cf-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.547201 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.547176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9695944-58fc-4a14-a192-5c3586c19e76-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.547329 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.547264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d759e102-32f6-492a-87c8-b9b8646958cf-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.554534 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.554509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2bmz\" (UniqueName: \"kubernetes.io/projected/e9695944-58fc-4a14-a192-5c3586c19e76-kube-api-access-n2bmz\") pod \"payload-pre-processing-7677b774bb-kswpp\" (UID: \"e9695944-58fc-4a14-a192-5c3586c19e76\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.554700 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.554661    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kdh\" (UniqueName: \"kubernetes.io/projected/d759e102-32f6-492a-87c8-b9b8646958cf-kube-api-access-v5kdh\") pod \"payload-processing-5bf47cd988-6b6qh\" (UID: \"d759e102-32f6-492a-87c8-b9b8646958cf\") " pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.599695 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.599656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:12.616400 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.616359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:12.790451 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.790421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6b6qh"]
Jul 21 04:18:12.791941 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:18:12.791912    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd759e102_32f6_492a_87c8_b9b8646958cf.slice/crio-b366e7e45e8a63c998678c6bb19ea2fa6d535d467b8a94a76a890b2ab31e0829 WatchSource:0}: Error finding container b366e7e45e8a63c998678c6bb19ea2fa6d535d467b8a94a76a890b2ab31e0829: Status 404 returned error can't find the container with id b366e7e45e8a63c998678c6bb19ea2fa6d535d467b8a94a76a890b2ab31e0829
Jul 21 04:18:12.965001 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:12.964974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kswpp"]
Jul 21 04:18:12.967062 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:18:12.967024    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9695944_58fc_4a14_a192_5c3586c19e76.slice/crio-02ea963aa2614b10b04fe2b4b8b4f6aff291ff6fb1ec068bfe74e8ca7b0e1026 WatchSource:0}: Error finding container 02ea963aa2614b10b04fe2b4b8b4f6aff291ff6fb1ec068bfe74e8ca7b0e1026: Status 404 returned error can't find the container with id 02ea963aa2614b10b04fe2b4b8b4f6aff291ff6fb1ec068bfe74e8ca7b0e1026
Jul 21 04:18:13.209993 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:13.209941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh" event={"ID":"d759e102-32f6-492a-87c8-b9b8646958cf","Type":"ContainerStarted","Data":"b366e7e45e8a63c998678c6bb19ea2fa6d535d467b8a94a76a890b2ab31e0829"}
Jul 21 04:18:13.211539 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:13.211500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp" event={"ID":"e9695944-58fc-4a14-a192-5c3586c19e76","Type":"ContainerStarted","Data":"02ea963aa2614b10b04fe2b4b8b4f6aff291ff6fb1ec068bfe74e8ca7b0e1026"}
Jul 21 04:18:16.231311 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.231273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh" event={"ID":"d759e102-32f6-492a-87c8-b9b8646958cf","Type":"ContainerStarted","Data":"0d6670de3ac8b1f99c75482488fbd58ec2c00e4b1804bf8da3e71b9104d8e813"}
Jul 21 04:18:16.231758 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.231416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:16.233320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.233282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp" event={"ID":"e9695944-58fc-4a14-a192-5c3586c19e76","Type":"ContainerStarted","Data":"6eec580f48b216734ea121de7e4962e40cadfbed5632c13d0ce1a3475872cffa"}
Jul 21 04:18:16.233812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.233790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:16.253439 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.253388    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh" podStartSLOduration=1.007132994 podStartE2EDuration="4.253373397s" totalImagesPullingTime="3.246240403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:16.25124871 +0000 UTC m=+845.001299209" watchObservedRunningTime="2026-07-21 04:18:16.253373397 +0000 UTC m=+845.003423894"
Jul 21 04:18:16.267100 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:16.267055    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp" podStartSLOduration=1.201704358 podStartE2EDuration="4.267042939s" totalImagesPullingTime="3.065338581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:16.265770213 +0000 UTC m=+845.015820722" watchObservedRunningTime="2026-07-21 04:18:16.267042939 +0000 UTC m=+845.017093463"
Jul 21 04:18:18.412443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:18.412410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:20.254956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.254869    2578 generic.go:356] "Generic (PLEG): container finished" podID="6278cca9-031b-4f29-aac3-e3a063643532" containerID="c4d012ed61df346c50585e97b37c4b1baf95b7fcc56012b4684926929a883b24" exitCode=0
Jul 21 04:18:20.255392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.254947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" event={"ID":"6278cca9-031b-4f29-aac3-e3a063643532","Type":"ContainerDied","Data":"c4d012ed61df346c50585e97b37c4b1baf95b7fcc56012b4684926929a883b24"}
Jul 21 04:18:20.255392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.255358    2578 scope.go:117] "RemoveContainer" containerID="c4d012ed61df346c50585e97b37c4b1baf95b7fcc56012b4684926929a883b24"
Jul 21 04:18:20.256440 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.256412    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:18:20.256519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.256486    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:18:20.256557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:20.256531    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:18:21.262159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:21.262126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" event={"ID":"6278cca9-031b-4f29-aac3-e3a063643532","Type":"ContainerStarted","Data":"dd8ea54a40500b7e7e1248a2aa6780086d85e0a8fefd7872777907913e02dd69"}
Jul 21 04:18:21.546714 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:21.546624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:18:21.547156 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:21.547117    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bz5xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:18:21.547346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:21.547188    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" podUID="6278cca9-031b-4f29-aac3-e3a063643532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 21 04:18:21.948074 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:21.948038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:22.046075 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:22.046036    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:22.547754 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:22.547714    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bz5xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:18:22.548164 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:22.547776    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" podUID="6278cca9-031b-4f29-aac3-e3a063643532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 21 04:18:23.546944 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:23.546903    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bz5xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:18:23.547118 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:23.546961    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" podUID="6278cca9-031b-4f29-aac3-e3a063643532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 21 04:18:24.546805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:24.546762    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bz5xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:18:24.547268 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:24.546825    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc" podUID="6278cca9-031b-4f29-aac3-e3a063643532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 21 04:18:25.550470 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:25.550440    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:18:25.550850 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:25.550791    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:18:25.551534 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:25.551513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bz5xc"
Jul 21 04:18:27.241724 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:27.241690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-6b6qh"
Jul 21 04:18:28.246344 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:28.246316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kswpp"
Jul 21 04:18:34.256090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.256051    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"]
Jul 21 04:18:34.260874 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.260854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.264357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.264332    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 04:18:34.265494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.265472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 04:18:34.265577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.265502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 04:18:34.265577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.265508    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7zhr\""
Jul 21 04:18:34.269969 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.269941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"]
Jul 21 04:18:34.283096 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.283027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:34.376321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.376321 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.376530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.376530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.376530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.376530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.376491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6njhk\" (UniqueName: \"kubernetes.io/projected/0cae1229-ac9c-4882-8553-cf10ef7f9c44-kube-api-access-6njhk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.477667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.477845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6njhk\" (UniqueName: \"kubernetes.io/projected/0cae1229-ac9c-4882-8553-cf10ef7f9c44-kube-api-access-6njhk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.477845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.477845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.477845 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.478073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.477914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.478154 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.478135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.478208 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.478186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.478284 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.478245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.480105 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.480083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cae1229-ac9c-4882-8553-cf10ef7f9c44-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.480296 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.480278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae1229-ac9c-4882-8553-cf10ef7f9c44-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.486704 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.486681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6njhk\" (UniqueName: \"kubernetes.io/projected/0cae1229-ac9c-4882-8553-cf10ef7f9c44-kube-api-access-6njhk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl\" (UID: \"0cae1229-ac9c-4882-8553-cf10ef7f9c44\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.572890 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.572804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:34.715636 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:34.715605    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"]
Jul 21 04:18:34.717709 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:18:34.717676    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cae1229_ac9c_4882_8553_cf10ef7f9c44.slice/crio-f4bf65138cff32cd23225361bd3b8faa19bc01c87e1acb48b10f3ca9bdb1903d WatchSource:0}: Error finding container f4bf65138cff32cd23225361bd3b8faa19bc01c87e1acb48b10f3ca9bdb1903d: Status 404 returned error can't find the container with id f4bf65138cff32cd23225361bd3b8faa19bc01c87e1acb48b10f3ca9bdb1903d
Jul 21 04:18:35.338737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:35.338696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl" event={"ID":"0cae1229-ac9c-4882-8553-cf10ef7f9c44","Type":"ContainerStarted","Data":"f4bf65138cff32cd23225361bd3b8faa19bc01c87e1acb48b10f3ca9bdb1903d"}
Jul 21 04:18:36.345345 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:36.345232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl" event={"ID":"0cae1229-ac9c-4882-8553-cf10ef7f9c44","Type":"ContainerStarted","Data":"69ad6eec8175b36b4b95e2aa3e897a4207468238882ce202a46b77c4b41b3caf"}
Jul 21 04:18:36.362671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:36.362618    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl" podStartSLOduration=1.064013071 podStartE2EDuration="2.362603159s" totalImagesPullingTime="1.298590088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:36.362353476 +0000 UTC m=+865.112403974" watchObservedRunningTime="2026-07-21 04:18:36.362603159 +0000 UTC m=+865.112653655"
Jul 21 04:18:44.157956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:44.157905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:18:44.573524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:44.573433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:44.573524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:44.573512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:44.586070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:44.586045    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:18:45.404694 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:18:45.404657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl"
Jul 21 04:19:10.182971 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:10.182875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:15.696320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:15.696292    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:19:15.696982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:15.696963    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:19:15.703515 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:15.703494    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:19:15.704121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:15.704102    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:19:19.864055 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:19.863999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:29.027366 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:29.027319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:32.475173 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.475137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"]
Jul 21 04:19:32.485745 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.485711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.488408 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.488379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 04:19:32.492624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.492594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"]
Jul 21 04:19:32.506998 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.506970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.507605 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.507577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.507731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.507614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqzt\" (UniqueName: \"kubernetes.io/projected/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-kube-api-access-fgqzt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.508583 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.507909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.508695 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.508632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.508762 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.508704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.513357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.513328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:32.610031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.609984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqzt\" (UniqueName: \"kubernetes.io/projected/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-kube-api-access-fgqzt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610604 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610678 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.610678 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.610661    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.612710 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.612685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.612808 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.612690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.619386 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.619354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqzt\" (UniqueName: \"kubernetes.io/projected/47988a8b-3c0f-4d8e-a42c-bd7c16e4e139-kube-api-access-fgqzt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h\" (UID: \"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.797257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.797131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:32.940461 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.940428    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"]
Jul 21 04:19:32.943457 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:19:32.943421    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47988a8b_3c0f_4d8e_a42c_bd7c16e4e139.slice/crio-e745eb45993d8d046a2401ac87d482453d520652e86ebd0c5de2f849a4d16cc3 WatchSource:0}: Error finding container e745eb45993d8d046a2401ac87d482453d520652e86ebd0c5de2f849a4d16cc3: Status 404 returned error can't find the container with id e745eb45993d8d046a2401ac87d482453d520652e86ebd0c5de2f849a4d16cc3
Jul 21 04:19:32.944927 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:32.944906    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:19:33.639703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:33.639671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h" event={"ID":"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139","Type":"ContainerStarted","Data":"b83e7cf9822bf18c9c7273fdb2782578b566a5c37a5119506f38889fe8335e54"}
Jul 21 04:19:33.640077 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:33.639724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h" event={"ID":"47988a8b-3c0f-4d8e-a42c-bd7c16e4e139","Type":"ContainerStarted","Data":"e745eb45993d8d046a2401ac87d482453d520652e86ebd0c5de2f849a4d16cc3"}
Jul 21 04:19:33.662275 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:33.662167    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h" podStartSLOduration=1.480106899 podStartE2EDuration="1.662150126s" totalImagesPullingTime="182.043227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:19:33.659597283 +0000 UTC m=+922.409647780" watchObservedRunningTime="2026-07-21 04:19:33.662150126 +0000 UTC m=+922.412200623"
Jul 21 04:19:42.139014 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.138979    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"]
Jul 21 04:19:42.142670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.142646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.144828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.144805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 04:19:42.154159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.154135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"]
Jul 21 04:19:42.174772 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.174743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:42.199688 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.199595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.199688 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.199646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.199956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.199928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.200033 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.199969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.200091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.200029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619272b2-520a-493c-a236-26f8fda36613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.200147 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.200131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9tf\" (UniqueName: \"kubernetes.io/projected/619272b2-520a-493c-a236-26f8fda36613-kube-api-access-7j9tf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301012 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.300974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619272b2-520a-493c-a236-26f8fda36613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301207 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9tf\" (UniqueName: \"kubernetes.io/projected/619272b2-520a-493c-a236-26f8fda36613-kube-api-access-7j9tf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.301560 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.301522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.303634 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.303609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619272b2-520a-493c-a236-26f8fda36613-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.303807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.303787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619272b2-520a-493c-a236-26f8fda36613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.308738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.308712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9tf\" (UniqueName: \"kubernetes.io/projected/619272b2-520a-493c-a236-26f8fda36613-kube-api-access-7j9tf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jq9pz\" (UID: \"619272b2-520a-493c-a236-26f8fda36613\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.454145 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.454109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:42.591884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.591855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"]
Jul 21 04:19:42.595150 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:19:42.595120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619272b2_520a_493c_a236_26f8fda36613.slice/crio-f83d8ed962cb8e4df5e678f60e96a5f30ba097494a8a51c85300c60913470c95 WatchSource:0}: Error finding container f83d8ed962cb8e4df5e678f60e96a5f30ba097494a8a51c85300c60913470c95: Status 404 returned error can't find the container with id f83d8ed962cb8e4df5e678f60e96a5f30ba097494a8a51c85300c60913470c95
Jul 21 04:19:42.686162 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.686130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz" event={"ID":"619272b2-520a-493c-a236-26f8fda36613","Type":"ContainerStarted","Data":"f83d8ed962cb8e4df5e678f60e96a5f30ba097494a8a51c85300c60913470c95"}
Jul 21 04:19:42.797416 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.797361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:42.797557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.797454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:42.810867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:42.810844    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:43.694134 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:43.694093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz" event={"ID":"619272b2-520a-493c-a236-26f8fda36613","Type":"ContainerStarted","Data":"20d9dc8ca663905b5190c138d95ffe8ffb38edce9a9c8802b0ec6b1dbcd36224"}
Jul 21 04:19:43.705554 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:43.705530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h"
Jul 21 04:19:43.713812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:43.713763    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz" podStartSLOduration=1.549726129 podStartE2EDuration="1.713744751s" totalImagesPullingTime="164.018622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:19:43.711833343 +0000 UTC m=+932.461883839" watchObservedRunningTime="2026-07-21 04:19:43.713744751 +0000 UTC m=+932.463795287"
Jul 21 04:19:46.640450 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:46.640412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:19:52.455039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:52.454994    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:52.455608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:52.455075    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:52.468747 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:52.468723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:19:52.750581 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:19:52.750490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jq9pz"
Jul 21 04:20:34.268738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:20:34.268649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:20:34.363702 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:20:34.363668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:20:35.454959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:20:35.454911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:20:35.549540 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:20:35.549493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:21:13.816815 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:13.816782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:21:22.884437 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:22.884397    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:21:22.885264 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:22.884929    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" podUID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" containerName="manager" containerID="cri-o://84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da" gracePeriod=30
Jul 21 04:21:23.144691 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.144618    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:21:23.206336 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.206299    2578 generic.go:356] "Generic (PLEG): container finished" podID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" containerID="84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da" exitCode=0
Jul 21 04:21:23.206519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.206348    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv"
Jul 21 04:21:23.206519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.206385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" event={"ID":"eddc9d32-bfc4-49a9-9067-fd86aca73fd8","Type":"ContainerDied","Data":"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"}
Jul 21 04:21:23.206519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.206433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-dm4gv" event={"ID":"eddc9d32-bfc4-49a9-9067-fd86aca73fd8","Type":"ContainerDied","Data":"7cf6461b13125f74b71039935200bf1c5364ff5e1afd4122f3dbfe6ee7688b4c"}
Jul 21 04:21:23.206519 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.206455    2578 scope.go:117] "RemoveContainer" containerID="84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"
Jul 21 04:21:23.217403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.217378    2578 scope.go:117] "RemoveContainer" containerID="84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"
Jul 21 04:21:23.217705 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:21:23.217689    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da\": container with ID starting with 84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da not found: ID does not exist" containerID="84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"
Jul 21 04:21:23.218140 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.218085    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da"} err="failed to get container status \"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da\": rpc error: code = NotFound desc = could not find container \"84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da\": container with ID starting with 84f2120fe01159282c1e9901c39f8ba433835cdd0feb43c01f0b28637ade71da not found: ID does not exist"
Jul 21 04:21:23.279271 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.279230    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2pzw\" (UniqueName: \"kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw\") pod \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") "
Jul 21 04:21:23.279443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.279292    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") pod \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\" (UID: \"eddc9d32-bfc4-49a9-9067-fd86aca73fd8\") "
Jul 21 04:21:23.281605 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.281567    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw" (OuterVolumeSpecName: "kube-api-access-s2pzw") pod "eddc9d32-bfc4-49a9-9067-fd86aca73fd8" (UID: "eddc9d32-bfc4-49a9-9067-fd86aca73fd8"). InnerVolumeSpecName "kube-api-access-s2pzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:21:23.281720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.281640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eddc9d32-bfc4-49a9-9067-fd86aca73fd8" (UID: "eddc9d32-bfc4-49a9-9067-fd86aca73fd8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:21:23.380886 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.380826    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2pzw\" (UniqueName: \"kubernetes.io/projected/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-kube-api-access-s2pzw\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:21:23.380886 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.380877    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eddc9d32-bfc4-49a9-9067-fd86aca73fd8-webhook-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:21:23.530539 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.530502    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:21:23.536121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.536091    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-dm4gv"]
Jul 21 04:21:23.781952 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:21:23.781863    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" path="/var/lib/kubelet/pods/eddc9d32-bfc4-49a9-9067-fd86aca73fd8/volumes"
Jul 21 04:22:06.597342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:06.597201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:22:24.417416 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.417380    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:24.417823 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.417810    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" containerName="manager"
Jul 21 04:22:24.417867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.417825    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" containerName="manager"
Jul 21 04:22:24.417920 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.417910    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eddc9d32-bfc4-49a9-9067-fd86aca73fd8" containerName="manager"
Jul 21 04:22:24.421148 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.421124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.424098 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.424072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kktkq\""
Jul 21 04:22:24.424257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.424076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 04:22:24.424257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.424124    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 04:22:24.430188 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.430164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:24.467331 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.467296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.467506 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.467340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktvdg\" (UniqueName: \"kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.568199 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.568165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.568403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.568238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktvdg\" (UniqueName: \"kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.570821 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.570802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.576166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.576137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktvdg\" (UniqueName: \"kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg\") pod \"maas-controller-7c9f7f6f8c-jmkzq\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") " pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.733128 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.733031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:24.872765 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:24.872738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:24.874834 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:22:24.874809    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6adbd8_65b1_42b7_a1f1_a111e40301e1.slice/crio-cda5331d7f4fc474e895e8623c43eb140b9c9c189de1861cc7dbb72a2425ec98 WatchSource:0}: Error finding container cda5331d7f4fc474e895e8623c43eb140b9c9c189de1861cc7dbb72a2425ec98: Status 404 returned error can't find the container with id cda5331d7f4fc474e895e8623c43eb140b9c9c189de1861cc7dbb72a2425ec98
Jul 21 04:22:25.556175 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:25.556138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" event={"ID":"0e6adbd8-65b1-42b7-a1f1-a111e40301e1","Type":"ContainerStarted","Data":"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"}
Jul 21 04:22:25.556642 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:25.556238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" event={"ID":"0e6adbd8-65b1-42b7-a1f1-a111e40301e1","Type":"ContainerStarted","Data":"cda5331d7f4fc474e895e8623c43eb140b9c9c189de1861cc7dbb72a2425ec98"}
Jul 21 04:22:25.556642 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:25.556261    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:25.574848 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:25.574793    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" podStartSLOduration=1.006901571 podStartE2EDuration="1.574778812s" totalImagesPullingTime="567.877241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:22:25.573072063 +0000 UTC m=+1094.323122560" watchObservedRunningTime="2026-07-21 04:22:25.574778812 +0000 UTC m=+1094.324829308"
Jul 21 04:22:36.564549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:36.564520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:41.184586 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.184523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:22:41.313813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.313784    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:41.314083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.314008    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" podUID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" containerName="manager" containerID="cri-o://a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf" gracePeriod=30
Jul 21 04:22:41.569159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.569136    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:41.629757 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.629724    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert\") pod \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") "
Jul 21 04:22:41.629914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.629789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktvdg\" (UniqueName: \"kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg\") pod \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\" (UID: \"0e6adbd8-65b1-42b7-a1f1-a111e40301e1\") "
Jul 21 04:22:41.631928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.631892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg" (OuterVolumeSpecName: "kube-api-access-ktvdg") pod "0e6adbd8-65b1-42b7-a1f1-a111e40301e1" (UID: "0e6adbd8-65b1-42b7-a1f1-a111e40301e1"). InnerVolumeSpecName "kube-api-access-ktvdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:22:41.632037 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.631981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e6adbd8-65b1-42b7-a1f1-a111e40301e1" (UID: "0e6adbd8-65b1-42b7-a1f1-a111e40301e1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:22:41.646337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.646310    2578 generic.go:356] "Generic (PLEG): container finished" podID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" containerID="a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf" exitCode=0
Jul 21 04:22:41.646463 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.646361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq"
Jul 21 04:22:41.646463 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.646398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" event={"ID":"0e6adbd8-65b1-42b7-a1f1-a111e40301e1","Type":"ContainerDied","Data":"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"}
Jul 21 04:22:41.646463 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.646451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-jmkzq" event={"ID":"0e6adbd8-65b1-42b7-a1f1-a111e40301e1","Type":"ContainerDied","Data":"cda5331d7f4fc474e895e8623c43eb140b9c9c189de1861cc7dbb72a2425ec98"}
Jul 21 04:22:41.646571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.646483    2578 scope.go:117] "RemoveContainer" containerID="a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"
Jul 21 04:22:41.656075 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.656059    2578 scope.go:117] "RemoveContainer" containerID="a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"
Jul 21 04:22:41.656356 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:22:41.656338    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf\": container with ID starting with a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf not found: ID does not exist" containerID="a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"
Jul 21 04:22:41.656421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.656365    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf"} err="failed to get container status \"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf\": rpc error: code = NotFound desc = could not find container \"a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf\": container with ID starting with a706a4438d95cf02067d0796e783b7d04861cbc91bca1060080cbce072640fcf not found: ID does not exist"
Jul 21 04:22:41.669262 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.669234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:41.673868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.673843    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-jmkzq"]
Jul 21 04:22:41.730863 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.730830    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-webhook-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:22:41.730863 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.730858    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktvdg\" (UniqueName: \"kubernetes.io/projected/0e6adbd8-65b1-42b7-a1f1-a111e40301e1-kube-api-access-ktvdg\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:22:41.781054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:41.780974    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" path="/var/lib/kubelet/pods/0e6adbd8-65b1-42b7-a1f1-a111e40301e1/volumes"
Jul 21 04:22:42.417853 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.417814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:22:42.550252 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.550201    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-q89gb"]
Jul 21 04:22:42.550634 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.550621    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" containerName="manager"
Jul 21 04:22:42.550685 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.550636    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" containerName="manager"
Jul 21 04:22:42.550723 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.550705    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6adbd8-65b1-42b7-a1f1-a111e40301e1" containerName="manager"
Jul 21 04:22:42.555039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.555021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.558013 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.557977    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 04:22:42.558147 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.558014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kktkq\""
Jul 21 04:22:42.558147 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.558020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 04:22:42.562169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.562131    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-q89gb"]
Jul 21 04:22:42.641350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.641182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.641350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.641251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxs2\" (UniqueName: \"kubernetes.io/projected/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-kube-api-access-kpxs2\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.742282 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.742160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.742282 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.742194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxs2\" (UniqueName: \"kubernetes.io/projected/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-kube-api-access-kpxs2\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.744819 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.744784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-webhook-cert\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.750861 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.750836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxs2\" (UniqueName: \"kubernetes.io/projected/fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31-kube-api-access-kpxs2\") pod \"maas-controller-7c9f7f6f8c-q89gb\" (UID: \"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31\") " pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:42.868309 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:42.868267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:43.012030 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:43.012002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9f7f6f8c-q89gb"]
Jul 21 04:22:43.013161 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:22:43.013139    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd522aa_e4f3_4114_ab3b_98ea7b6f1d31.slice/crio-262993f0d1b66c5c37e6cddee3fac69ad9c9d7a522a1b451da590b2cc2d09dc3 WatchSource:0}: Error finding container 262993f0d1b66c5c37e6cddee3fac69ad9c9d7a522a1b451da590b2cc2d09dc3: Status 404 returned error can't find the container with id 262993f0d1b66c5c37e6cddee3fac69ad9c9d7a522a1b451da590b2cc2d09dc3
Jul 21 04:22:43.659553 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:43.659521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb" event={"ID":"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31","Type":"ContainerStarted","Data":"3701b970f71e82861104fbadd9cd1d395db27cbb7ca354936c9ddaebd0be3d25"}
Jul 21 04:22:43.659988 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:43.659578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb" event={"ID":"fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31","Type":"ContainerStarted","Data":"262993f0d1b66c5c37e6cddee3fac69ad9c9d7a522a1b451da590b2cc2d09dc3"}
Jul 21 04:22:43.659988 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:43.659634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:22:43.684807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:43.684750    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb" podStartSLOduration=1.343208774 podStartE2EDuration="1.684732641s" totalImagesPullingTime="341.523867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:22:43.68297535 +0000 UTC m=+1112.433025848" watchObservedRunningTime="2026-07-21 04:22:43.684732641 +0000 UTC m=+1112.434783137"
Jul 21 04:22:54.668019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:22:54.667982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9f7f6f8c-q89gb"
Jul 21 04:23:18.493440 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:18.493396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:18.646623 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:18.646585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:18.791280 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:18.791176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:24.764401 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:24.764350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:24.879604 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:24.879572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:24.978438 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:24.978393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:25.161668 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:25.161637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:31.105118 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:31.105085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:23:31.205448 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:23:31.205387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:24:15.735220 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:24:15.735188    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:24:15.740355 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:24:15.740329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:24:15.746379 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:24:15.746353    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:24:15.748021 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:24:15.748004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:26:09.970842 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:26:09.970810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:26:44.498234 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:26:44.498175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:26:44.600023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:26:44.599992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:27:25.059879 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:25.059840    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:27:25.060483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:25.060056    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" podUID="4369fa65-4051-4f03-ab53-06e63e073bc3" containerName="manager" containerID="cri-o://675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af" gracePeriod=10
Jul 21 04:27:27.619336 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.619310    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:27:27.728993 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.728957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffwvt\" (UniqueName: \"kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt\") pod \"4369fa65-4051-4f03-ab53-06e63e073bc3\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") "
Jul 21 04:27:27.729175 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.729063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume\") pod \"4369fa65-4051-4f03-ab53-06e63e073bc3\" (UID: \"4369fa65-4051-4f03-ab53-06e63e073bc3\") "
Jul 21 04:27:27.729508 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.729483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4369fa65-4051-4f03-ab53-06e63e073bc3" (UID: "4369fa65-4051-4f03-ab53-06e63e073bc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:27:27.731291 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.731267    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt" (OuterVolumeSpecName: "kube-api-access-ffwvt") pod "4369fa65-4051-4f03-ab53-06e63e073bc3" (UID: "4369fa65-4051-4f03-ab53-06e63e073bc3"). InnerVolumeSpecName "kube-api-access-ffwvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:27:27.830584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.830550    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4369fa65-4051-4f03-ab53-06e63e073bc3-extensions-socket-volume\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:27:27.830584 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:27.830579    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffwvt\" (UniqueName: \"kubernetes.io/projected/4369fa65-4051-4f03-ab53-06e63e073bc3-kube-api-access-ffwvt\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:27:28.115785 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.115682    2578 generic.go:356] "Generic (PLEG): container finished" podID="4369fa65-4051-4f03-ab53-06e63e073bc3" containerID="675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af" exitCode=0
Jul 21 04:27:28.115959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.115784    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"
Jul 21 04:27:28.115959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.115822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" event={"ID":"4369fa65-4051-4f03-ab53-06e63e073bc3","Type":"ContainerDied","Data":"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"}
Jul 21 04:27:28.115959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.115880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp" event={"ID":"4369fa65-4051-4f03-ab53-06e63e073bc3","Type":"ContainerDied","Data":"5fe0862e7369dc3bd5fd77ce24661ca56da6345489f9d69a54e6901a504bf7ec"}
Jul 21 04:27:28.115959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.115910    2578 scope.go:117] "RemoveContainer" containerID="675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"
Jul 21 04:27:28.126036 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.126019    2578 scope.go:117] "RemoveContainer" containerID="675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"
Jul 21 04:27:28.126369 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:27:28.126351    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af\": container with ID starting with 675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af not found: ID does not exist" containerID="675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"
Jul 21 04:27:28.126448 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.126375    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af"} err="failed to get container status \"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af\": rpc error: code = NotFound desc = could not find container \"675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af\": container with ID starting with 675910d11583aeda9834d3cdc2e613c94724d03a714e52e8fca70493b3d835af not found: ID does not exist"
Jul 21 04:27:28.134179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.134155    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:27:28.137297 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:28.137277    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8lqp"]
Jul 21 04:27:29.780981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:27:29.780947    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4369fa65-4051-4f03-ab53-06e63e073bc3" path="/var/lib/kubelet/pods/4369fa65-4051-4f03-ab53-06e63e073bc3/volumes"
Jul 21 04:28:12.986316 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:12.986284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:28:26.280604 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.280572    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"]
Jul 21 04:28:26.283023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.280978    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4369fa65-4051-4f03-ab53-06e63e073bc3" containerName="manager"
Jul 21 04:28:26.283023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.280991    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4369fa65-4051-4f03-ab53-06e63e073bc3" containerName="manager"
Jul 21 04:28:26.283023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.281064    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4369fa65-4051-4f03-ab53-06e63e073bc3" containerName="manager"
Jul 21 04:28:26.284009 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.283994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.286310 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.286289    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d5s6t\""
Jul 21 04:28:26.294956 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.294935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"]
Jul 21 04:28:26.384262 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.384203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd07dfb3-8c5b-48ee-b954-72c4c9315983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.384464 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.384269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxcw\" (UniqueName: \"kubernetes.io/projected/cd07dfb3-8c5b-48ee-b954-72c4c9315983-kube-api-access-rwxcw\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.485083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.485046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd07dfb3-8c5b-48ee-b954-72c4c9315983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.485083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.485089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxcw\" (UniqueName: \"kubernetes.io/projected/cd07dfb3-8c5b-48ee-b954-72c4c9315983-kube-api-access-rwxcw\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.485481 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.485461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd07dfb3-8c5b-48ee-b954-72c4c9315983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.499531 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.499502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxcw\" (UniqueName: \"kubernetes.io/projected/cd07dfb3-8c5b-48ee-b954-72c4c9315983-kube-api-access-rwxcw\") pod \"kuadrant-operator-controller-manager-86878c769f-sp6c6\" (UID: \"cd07dfb3-8c5b-48ee-b954-72c4c9315983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.594958 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.594865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:26.744144 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:26.744121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"]
Jul 21 04:28:26.747423 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:28:26.747394    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd07dfb3_8c5b_48ee_b954_72c4c9315983.slice/crio-27ff4bd9f27b6dfe5e75f0cb45901b44ffa618c2c61d0398159b9ec15e94bb20 WatchSource:0}: Error finding container 27ff4bd9f27b6dfe5e75f0cb45901b44ffa618c2c61d0398159b9ec15e94bb20: Status 404 returned error can't find the container with id 27ff4bd9f27b6dfe5e75f0cb45901b44ffa618c2c61d0398159b9ec15e94bb20
Jul 21 04:28:27.413976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:27.413946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6" event={"ID":"cd07dfb3-8c5b-48ee-b954-72c4c9315983","Type":"ContainerStarted","Data":"8f6832aead0bd57abfd3b5a3f0fc9897f2d8be9d5cf074b27385b43d921c33cc"}
Jul 21 04:28:27.414377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:27.413998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6" event={"ID":"cd07dfb3-8c5b-48ee-b954-72c4c9315983","Type":"ContainerStarted","Data":"27ff4bd9f27b6dfe5e75f0cb45901b44ffa618c2c61d0398159b9ec15e94bb20"}
Jul 21 04:28:27.414377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:27.414044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:28:27.439796 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:27.439743    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6" podStartSLOduration=1.439726402 podStartE2EDuration="1.439726402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:28:27.4376193 +0000 UTC m=+1456.187669797" watchObservedRunningTime="2026-07-21 04:28:27.439726402 +0000 UTC m=+1456.189776900"
Jul 21 04:28:37.069043 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:37.069007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:28:38.421880 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:28:38.421852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sp6c6"
Jul 21 04:29:15.770498 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:29:15.770465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:29:15.773328 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:29:15.773302    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:29:15.778748 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:29:15.778685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:29:15.781418 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:29:15.781396    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:31:04.942297 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:04.942181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:31:15.083435 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:15.083400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:31:16.339737 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:16.339696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:31:25.093742 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.093707    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:31:25.097446 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.097425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.100969 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.100947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ea07417e-kserve-self-signed-certs\""
Jul 21 04:31:25.115422 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.115393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:31:25.154125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.154088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:31:25.185285 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.185490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wl4d\" (UniqueName: \"kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.185490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.185490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.185490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.185724 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.185519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.286612 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.286572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.286807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.286656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.286807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.286721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wl4d\" (UniqueName: \"kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.286807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.286749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.286807 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.286795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.287242 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.287063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.287368 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.287249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.287368 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.287253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.287485 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.287433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.289442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.289414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.289846 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.289828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.299169 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.299129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wl4d\" (UniqueName: \"kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d\") pod \"e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") " pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.408759 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.408722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:25.555362 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:25.555335    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:31:25.557466 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:31:25.557436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod836115d3_cbe4_4e00_bd1c_236a4e8b5b94.slice/crio-ffdbf841603564147bd8c27e7aca2c5769c9c035f0861eb0cc4e4b2eba13aa0e WatchSource:0}: Error finding container ffdbf841603564147bd8c27e7aca2c5769c9c035f0861eb0cc4e4b2eba13aa0e: Status 404 returned error can't find the container with id ffdbf841603564147bd8c27e7aca2c5769c9c035f0861eb0cc4e4b2eba13aa0e
Jul 21 04:31:26.348467 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:26.348421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" event={"ID":"836115d3-cbe4-4e00-bd1c-236a4e8b5b94","Type":"ContainerStarted","Data":"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"}
Jul 21 04:31:26.348869 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:26.348478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" event={"ID":"836115d3-cbe4-4e00-bd1c-236a4e8b5b94","Type":"ContainerStarted","Data":"ffdbf841603564147bd8c27e7aca2c5769c9c035f0861eb0cc4e4b2eba13aa0e"}
Jul 21 04:31:26.370180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:26.370124    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" podStartSLOduration=1.370106989 podStartE2EDuration="1.370106989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:31:26.369549351 +0000 UTC m=+1635.119599848" watchObservedRunningTime="2026-07-21 04:31:26.370106989 +0000 UTC m=+1635.120157541"
Jul 21 04:31:35.409489 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:35.409440    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:35.409978 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:35.409520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:35.422024 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:35.421999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:36.418670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:36.418641    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:31:44.325059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:44.325009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:31:45.824923 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:45.824877    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:31:45.849564 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:31:45.849534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:32:00.847370 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:00.847285    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" podUID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" containerName="main" containerID="cri-o://3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb" gracePeriod=45
Jul 21 04:32:01.111229 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.111143    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:32:01.138782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.138750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.138782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.138782    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.139020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.138874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.139020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.138895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wl4d\" (UniqueName: \"kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.139020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.138955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.139020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home\") pod \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\" (UID: \"836115d3-cbe4-4e00-bd1c-236a4e8b5b94\") "
Jul 21 04:32:01.139247 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139063    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache" (OuterVolumeSpecName: "model-cache") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:32:01.139350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139315    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home" (OuterVolumeSpecName: "home") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:32:01.139350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:32:01.139455 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139406    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-home\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.139455 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.139430    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-model-cache\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.141448 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.141416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm" (OuterVolumeSpecName: "dshm") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:32:01.141448 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.141433    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d" (OuterVolumeSpecName: "kube-api-access-9wl4d") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "kube-api-access-9wl4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:32:01.141593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.141451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "836115d3-cbe4-4e00-bd1c-236a4e8b5b94" (UID: "836115d3-cbe4-4e00-bd1c-236a4e8b5b94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:32:01.240927 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.240888    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-dshm\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.240927 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.240922    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wl4d\" (UniqueName: \"kubernetes.io/projected/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-kube-api-access-9wl4d\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.240927 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.240932    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tmp-dir\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.241170 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.240943    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/836115d3-cbe4-4e00-bd1c-236a4e8b5b94-tls-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:32:01.541734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.541697    2578 generic.go:356] "Generic (PLEG): container finished" podID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" containerID="3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb" exitCode=0
Jul 21 04:32:01.541914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.541753    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"
Jul 21 04:32:01.541914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.541777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" event={"ID":"836115d3-cbe4-4e00-bd1c-236a4e8b5b94","Type":"ContainerDied","Data":"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"}
Jul 21 04:32:01.541914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.541832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk" event={"ID":"836115d3-cbe4-4e00-bd1c-236a4e8b5b94","Type":"ContainerDied","Data":"ffdbf841603564147bd8c27e7aca2c5769c9c035f0861eb0cc4e4b2eba13aa0e"}
Jul 21 04:32:01.541914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.541849    2578 scope.go:117] "RemoveContainer" containerID="3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"
Jul 21 04:32:01.552140 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.552111    2578 scope.go:117] "RemoveContainer" containerID="3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"
Jul 21 04:32:01.552435 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:32:01.552410    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb\": container with ID starting with 3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb not found: ID does not exist" containerID="3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"
Jul 21 04:32:01.552494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.552445    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb"} err="failed to get container status \"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb\": rpc error: code = NotFound desc = could not find container \"3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb\": container with ID starting with 3134d124d52906afad604407bff8a550f45bc6ad16f98706550f4134ab4515fb not found: ID does not exist"
Jul 21 04:32:01.564062 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.564037    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:32:01.568120 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.568100    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ea07417e-kserve-55848b68c5-2tsmk"]
Jul 21 04:32:01.782105 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:32:01.782072    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" path="/var/lib/kubelet/pods/836115d3-cbe4-4e00-bd1c-236a4e8b5b94/volumes"
Jul 21 04:34:15.811726 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:15.811695    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:34:15.814013 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:15.813988    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:34:15.820030 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:15.820001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:34:15.822837 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:15.822817    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:34:47.680638 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:47.680597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:34:50.816374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:50.816328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:34:56.249556 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:34:56.249515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:04.521432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:04.521387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:12.943031 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:12.942993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:16.049432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:16.049381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:16.149670 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:16.149636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:16.532059 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:16.532023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:22.238004 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:22.237951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:22.290246 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:22.290181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:22.474083 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:22.474044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:22.806570 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:22.806515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:23.005954 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:23.005911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:25.372355 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:25.372319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:25.472015 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:25.471975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:25.584550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:25.584501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:26.009414 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:26.009376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:26.235249 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:26.235172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:26.336397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:26.336276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:29.846744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:29.846713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:35:52.232692 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:35:52.232654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:01.414669 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:01.414624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.082104 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.082068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.249355 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.249317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.503879 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.503839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.780495 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.780391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.873499 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.873462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:06.984982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:06.984940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:07.288709 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.288668    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:07.289181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.289092    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" containerName="main"
Jul 21 04:36:07.289181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.289104    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" containerName="main"
Jul 21 04:36:07.289181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.289168    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="836115d3-cbe4-4e00-bd1c-236a4e8b5b94" containerName="main"
Jul 21 04:36:07.292973 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.292942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.295245 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.295192    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-75c76546-gw-openshift-default-dockercfg-l2v2h\""
Jul 21 04:36:07.302681 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.302656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:07.316959 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.316925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:07.410474 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410667 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410787 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410787 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410855 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410896 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.410931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.410906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mff\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.412843 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.412808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:07.511957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.511912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.511957 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.511958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512248 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mff\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512589 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512659 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512659 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.512770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.512701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.513170 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.513138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.514825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.514797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.514906 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.514833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.520913 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.520887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.521035 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.521019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mff\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff\") pod \"e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") " pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.606158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.606059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:07.750398 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.750367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:07.752295 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:36:07.752264    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603b1069_6e5c_49f9_8195_490a097bd740.slice/crio-fb8addb0e49ff14abe8a9fd76028ea3ae653b29734eb22ae3bc979fe02edec34 WatchSource:0}: Error finding container fb8addb0e49ff14abe8a9fd76028ea3ae653b29734eb22ae3bc979fe02edec34: Status 404 returned error can't find the container with id fb8addb0e49ff14abe8a9fd76028ea3ae653b29734eb22ae3bc979fe02edec34
Jul 21 04:36:07.754501 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.754466    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:07.754602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.754532    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:07.754602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.754561    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:07.842565 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.842533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerStarted","Data":"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"}
Jul 21 04:36:07.842722 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.842587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerStarted","Data":"fb8addb0e49ff14abe8a9fd76028ea3ae653b29734eb22ae3bc979fe02edec34"}
Jul 21 04:36:07.861421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:07.861314    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podStartSLOduration=0.861293783 podStartE2EDuration="861.293783ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:36:07.859931106 +0000 UTC m=+1916.609981604" watchObservedRunningTime="2026-07-21 04:36:07.861293783 +0000 UTC m=+1916.611344284"
Jul 21 04:36:08.606977 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:08.606944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:08.612174 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:08.612147    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:08.848966 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:08.848934    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:08.850078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:08.850061    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:09.350784 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:09.350749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:09.586036 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:09.585973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:10.106269 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:10.106205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:10.206793 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:10.206754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:23.850786 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.850746    2578 patch_prober.go:28] interesting pod/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 21 04:36:23.851194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.850819    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 21 04:36:23.937550 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.937515    2578 generic.go:356] "Generic (PLEG): container finished" podID="603b1069-6e5c-49f9-8195-490a097bd740" containerID="bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a" exitCode=0
Jul 21 04:36:23.937731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.937603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerDied","Data":"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"}
Jul 21 04:36:23.938081 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.938066    2578 scope.go:117] "RemoveContainer" containerID="bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"
Jul 21 04:36:23.939131 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.939098    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:23.939197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.939173    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:23.939267 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:23.939229    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:36:24.944980 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:24.944941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerStarted","Data":"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"}
Jul 21 04:36:25.606785 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:25.606740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:25.607093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:25.607065    2578 patch_prober.go:28] interesting pod/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 21 04:36:25.607310 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:25.607281    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 21 04:36:26.607053 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:26.607013    2578 patch_prober.go:28] interesting pod/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 21 04:36:26.607582 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:26.607317    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 21 04:36:27.607023 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:27.606969    2578 patch_prober.go:28] interesting pod/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 21 04:36:27.607252 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:27.607045    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 21 04:36:28.606594 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:28.606539    2578 patch_prober.go:28] interesting pod/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 21 04:36:28.606825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:28.606632    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 21 04:36:29.611401 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:29.611371    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:29.611781 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:29.611757    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:29.612637 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:29.612618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:44.837350 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:44.837312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:49.458733 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:49.458692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:49.597376 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:49.597339    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:49.597588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:49.597565    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy" containerID="cri-o://04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845" gracePeriod=30
Jul 21 04:36:49.622389 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:49.622361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:49.866095 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:49.866008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:50.127716 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:50.127626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:50.449349 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:50.449317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:50.528793 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:50.528751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:52.793007 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:52.792973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:52.886946 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:52.886799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:52.963805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:52.963775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:53.065058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:53.064962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:53.540620 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:53.540577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:53.645623 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:53.645573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:36:54.860988 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.860924    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:54.990515 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990481    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990717 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8mff\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.990931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:54.990931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.990843    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket\") pod \"603b1069-6e5c-49f9-8195-490a097bd740\" (UID: \"603b1069-6e5c-49f9-8195-490a097bd740\") "
Jul 21 04:36:54.991180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.991159    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:54.991277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.991247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:36:54.991436 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.991392    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:54.991583 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.991560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:54.991832 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.991797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data" (OuterVolumeSpecName: "istio-data") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:54.993194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.993164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token" (OuterVolumeSpecName: "istio-token") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:54.993626 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.993592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff" (OuterVolumeSpecName: "kube-api-access-x8mff") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "kube-api-access-x8mff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:54.993703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.993625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:54.993703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:54.993673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "603b1069-6e5c-49f9-8195-490a097bd740" (UID: "603b1069-6e5c-49f9-8195-490a097bd740"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:36:55.091686 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091653    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-envoy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091686 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091684    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603b1069-6e5c-49f9-8195-490a097bd740-istio-podinfo\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091686 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091695    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8mff\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-kube-api-access-x8mff\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091705    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-workload-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091716    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603b1069-6e5c-49f9-8195-490a097bd740-istiod-ca-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091725    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-credential-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091732    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603b1069-6e5c-49f9-8195-490a097bd740-istio-data\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.091928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.091740    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603b1069-6e5c-49f9-8195-490a097bd740-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:36:55.114508 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.114425    2578 generic.go:356] "Generic (PLEG): container finished" podID="603b1069-6e5c-49f9-8195-490a097bd740" containerID="04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845" exitCode=0
Jul 21 04:36:55.114508 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.114476    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"
Jul 21 04:36:55.114671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.114513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerDied","Data":"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"}
Jul 21 04:36:55.114671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.114577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8" event={"ID":"603b1069-6e5c-49f9-8195-490a097bd740","Type":"ContainerDied","Data":"fb8addb0e49ff14abe8a9fd76028ea3ae653b29734eb22ae3bc979fe02edec34"}
Jul 21 04:36:55.114671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.114608    2578 scope.go:117] "RemoveContainer" containerID="04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"
Jul 21 04:36:55.124608 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.124587    2578 scope.go:117] "RemoveContainer" containerID="bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"
Jul 21 04:36:55.133261 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.133241    2578 scope.go:117] "RemoveContainer" containerID="04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"
Jul 21 04:36:55.133540 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:36:55.133515    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845\": container with ID starting with 04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845 not found: ID does not exist" containerID="04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"
Jul 21 04:36:55.133598 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.133554    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845"} err="failed to get container status \"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845\": rpc error: code = NotFound desc = could not find container \"04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845\": container with ID starting with 04b3c19ae46efa04bb13d141e9a5837e63def9a0ef727e5152ccd2432d09b845 not found: ID does not exist"
Jul 21 04:36:55.133598 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.133579    2578 scope.go:117] "RemoveContainer" containerID="bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"
Jul 21 04:36:55.133853 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:36:55.133805    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a\": container with ID starting with bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a not found: ID does not exist" containerID="bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"
Jul 21 04:36:55.133853 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.133832    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a"} err="failed to get container status \"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a\": rpc error: code = NotFound desc = could not find container \"bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a\": container with ID starting with bea29ee79eba69027aa0dbf3aee3d1bc6f0ffb944a42720748932283bab9c99a not found: ID does not exist"
Jul 21 04:36:55.136697 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.136676    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:55.142188 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.142167    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-75c76546-gw-openshift-default-9bf945d67-pwll8"]
Jul 21 04:36:55.781406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:36:55.781374    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603b1069-6e5c-49f9-8195-490a097bd740" path="/var/lib/kubelet/pods/603b1069-6e5c-49f9-8195-490a097bd740/volumes"
Jul 21 04:37:29.368549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:29.368512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:33.801167 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:33.801129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:35.076375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.076340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:35.322411 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.322372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:35.608071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.608016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:35.889907 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.889826    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:37:35.890289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.890271    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:37:35.890375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.890291    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:37:35.890432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.890378    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:37:35.890432 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.890389    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:37:35.893777 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.893747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.897481 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.897455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5016fdfc-openshift-default-dockercfg-6bhpv\""
Jul 21 04:37:35.908173 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.908148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:37:35.924093 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.924065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:35.983145 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983145 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pn2n\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983434 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:35.983703 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:35.983539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pn2n\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.084912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.084814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.085391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.085051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.085391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.085125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.085504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.085460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.086052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.085565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.088397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.088360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.088621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.088600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.094846 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.094823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pn2n\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.094987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.094965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token\") pod \"e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") " pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.204748 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.204712    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:36.241490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.241459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:36.356820 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.356793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:37:36.359084 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:37:36.359056    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc887dc65_f162_4ece_98da_1cb93aa53ac5.slice/crio-18849e34b330f0762816af8a6bcb772ac4d86219087d664dad4accd31d708d06 WatchSource:0}: Error finding container 18849e34b330f0762816af8a6bcb772ac4d86219087d664dad4accd31d708d06: Status 404 returned error can't find the container with id 18849e34b330f0762816af8a6bcb772ac4d86219087d664dad4accd31d708d06
Jul 21 04:37:36.361237 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.361187    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:36.361327 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.361273    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:36.361327 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:36.361305    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:37.329998 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:37.329962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerStarted","Data":"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"}
Jul 21 04:37:37.330465 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:37.330038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerStarted","Data":"18849e34b330f0762816af8a6bcb772ac4d86219087d664dad4accd31d708d06"}
Jul 21 04:37:37.355658 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:37.355603    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podStartSLOduration=2.355585426 podStartE2EDuration="2.355585426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:37:37.353872878 +0000 UTC m=+2006.103923369" watchObservedRunningTime="2026-07-21 04:37:37.355585426 +0000 UTC m=+2006.105635923"
Jul 21 04:37:38.205577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:38.205541    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:38.210596 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:38.210570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:38.335443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:38.335412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:38.336335 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:38.336316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:38.799821 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:38.799781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:39.002179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:39.002145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:39.124755 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:39.124671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:39.297433 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:39.297393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:39.938731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:39.938699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:40.059339 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:40.059311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:37:52.434142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.434106    2578 generic.go:356] "Generic (PLEG): container finished" podID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerID="00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea" exitCode=0
Jul 21 04:37:52.434569 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.434162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerDied","Data":"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"}
Jul 21 04:37:52.434613 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.434569    2578 scope.go:117] "RemoveContainer" containerID="00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"
Jul 21 04:37:52.435675 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.435643    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:52.435739 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.435719    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:52.435774 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:52.435758    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:37:53.336296 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:53.336260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:53.441645 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:53.441605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerStarted","Data":"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"}
Jul 21 04:37:54.205330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:54.205243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:54.207090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:54.207056    2578 patch_prober.go:28] interesting pod/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 04:37:54.207339 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:54.207305    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 04:37:55.205987 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:55.205944    2578 patch_prober.go:28] interesting pod/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 04:37:55.206616 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:55.206581    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 04:37:56.205834 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:56.205780    2578 patch_prober.go:28] interesting pod/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 04:37:56.206045 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:56.205857    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 04:37:57.205336 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:57.205289    2578 patch_prober.go:28] interesting pod/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 04:37:57.205530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:57.205370    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 04:37:58.209415 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:58.209382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:58.209825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:58.209675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:37:58.210294 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:37:58.210273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:38:04.456265 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:04.456203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:04.588662 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:04.588602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:05.531455 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:05.531414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:05.774523 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:05.774474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:14.545147 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:14.545114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:18.908976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:18.908940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:19.081592 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:19.081559    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:38:19.081817 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:19.081790    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy" containerID="cri-o://52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a" gracePeriod=30
Jul 21 04:38:19.185936 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:19.185852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:19.423704 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:19.423659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:20.022375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:20.022340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:20.181317 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:20.181280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:22.058426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:22.058393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:24.345177 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.345109    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:38:24.479644 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479608    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pn2n\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479644 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479772    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.479851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.479850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket\") pod \"c887dc65-f162-4ece-98da-1cb93aa53ac5\" (UID: \"c887dc65-f162-4ece-98da-1cb93aa53ac5\") "
Jul 21 04:38:24.480346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.480320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:24.480557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.480354    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:24.480557 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.480451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:24.480877 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.480744    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:38:24.481426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.481379    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:24.482589 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.482557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:38:24.482672 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.482583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:38:24.482672 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.482590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:24.482862 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.482837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n" (OuterVolumeSpecName: "kube-api-access-2pn2n") pod "c887dc65-f162-4ece-98da-1cb93aa53ac5" (UID: "c887dc65-f162-4ece-98da-1cb93aa53ac5"). InnerVolumeSpecName "kube-api-access-2pn2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:38:24.580751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580713    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-credential-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.580751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580745    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-podinfo\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.580751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580754    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-envoy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.580751 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580762    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c887dc65-f162-4ece-98da-1cb93aa53ac5-istiod-ca-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.581090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580769    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-data\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.581090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580777    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.581090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580784    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pn2n\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-kube-api-access-2pn2n\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.581090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580792    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c887dc65-f162-4ece-98da-1cb93aa53ac5-workload-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.581090 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.580800    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c887dc65-f162-4ece-98da-1cb93aa53ac5-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:38:24.600782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.600698    2578 generic.go:356] "Generic (PLEG): container finished" podID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerID="52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a" exitCode=0
Jul 21 04:38:24.600782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.600760    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"
Jul 21 04:38:24.600962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.600775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerDied","Data":"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"}
Jul 21 04:38:24.600962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.600868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk" event={"ID":"c887dc65-f162-4ece-98da-1cb93aa53ac5","Type":"ContainerDied","Data":"18849e34b330f0762816af8a6bcb772ac4d86219087d664dad4accd31d708d06"}
Jul 21 04:38:24.600962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.600897    2578 scope.go:117] "RemoveContainer" containerID="52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"
Jul 21 04:38:24.611065 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.611047    2578 scope.go:117] "RemoveContainer" containerID="00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"
Jul 21 04:38:24.621934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.621910    2578 scope.go:117] "RemoveContainer" containerID="52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"
Jul 21 04:38:24.622311 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:38:24.622286    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a\": container with ID starting with 52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a not found: ID does not exist" containerID="52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"
Jul 21 04:38:24.622378 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.622324    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a"} err="failed to get container status \"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a\": rpc error: code = NotFound desc = could not find container \"52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a\": container with ID starting with 52bb11d7c8c232bb6230a340d349214fb550c136db491947abaf2a7bb1e4792a not found: ID does not exist"
Jul 21 04:38:24.622378 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.622348    2578 scope.go:117] "RemoveContainer" containerID="00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"
Jul 21 04:38:24.622644 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:38:24.622623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea\": container with ID starting with 00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea not found: ID does not exist" containerID="00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"
Jul 21 04:38:24.622711 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.622664    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea"} err="failed to get container status \"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea\": rpc error: code = NotFound desc = could not find container \"00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea\": container with ID starting with 00aaad9cedaf7c0478e1681c75129b465239856e3a04ff10f6c991f081cb31ea not found: ID does not exist"
Jul 21 04:38:24.649666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.649623    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:38:24.664304 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:24.664271    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5016fdfc-openshift-default-58687b4d7-cr4pk"]
Jul 21 04:38:25.781986 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:25.781949    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" path="/var/lib/kubelet/pods/c887dc65-f162-4ece-98da-1cb93aa53ac5/volumes"
Jul 21 04:38:29.986806 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:29.986770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:30.198003 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:30.197968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:30.385397 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:30.385304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:30.856159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:30.856119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:38:57.036061 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:38:57.036021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:07.691935 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:07.691882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:07.878091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:07.878051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:08.037922 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:08.037803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:15.847673 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:15.847642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:39:15.850896 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:15.850872    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:39:15.855421 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:15.855387    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:39:15.858436 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:15.858418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:39:23.971559 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:23.971518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:30.089740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:30.089701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:30.287091 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:30.287056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:30.431503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:30.431465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:34.916919 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:34.916885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:40.936642 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:40.936605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:41.769775 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:41.769741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:48.047757 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:48.047723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:48.169510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:48.169463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:48.311370 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:48.311289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:48.419734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:48.419700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:49.231517 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:49.231487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:49.323748 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:49.323710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:49.394326 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:49.394295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:51.103454 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:51.103416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:57.228790 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:57.228752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:57.328127 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:57.328095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:39:57.912936 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:39:57.912892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:04.620114 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:04.620013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:04.720568 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:04.720528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:04.947766 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:04.947730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:05.210268 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:05.210158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:05.416171 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:05.416138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:08.292354 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:08.292315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:08.398555 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:08.398518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:08.466558 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:08.466525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:08.666504 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:08.666469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:09.005446 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:09.005353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:09.110683 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:09.110654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:12.833019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:12.832984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:13.552477 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:13.552439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:13.649510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:13.649456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:14.004060 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:14.004022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:19.899939 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:19.899901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:19.984847 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:19.984809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:24.678794 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:24.678768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:30.865114 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:30.865073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:35.355087 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:35.355047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:35.411669 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:35.411637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:35.754100 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:35.754065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:41.736740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:41.736691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:41.837201 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:41.837167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:42.004783 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:42.004704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:42.248676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:42.248644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:42.371473 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:42.371365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:42.470871 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:42.470836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:42.609370 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:42.609309    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:48.353624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:48.353590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:48.420077 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:48.420041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:48.489541 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:48.489510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:48.585754 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:48.585722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:48.715476 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:48.715444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:54.469381 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:54.469349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:40:54.569456 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:40:54.569420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:01.452834 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:01.452792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:01.769702 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:01.769593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:02.020656 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:02.020578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:04.533743 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:04.533701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:04.611638 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:04.611604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:04.681566 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:04.681534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:04.782054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:04.782022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:05.091963 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:05.091929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:05.193051 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:05.193021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:09.055343 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:09.055303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:18.357730 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:18.357686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:23.282569 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:23.282527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:50.575611 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:50.575577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:41:51.991018 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:41:51.990987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:03.208374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:03.208336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:07.779072 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:07.779038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:10.115289 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:10.115198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:15.142474 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:15.142427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:52.525650 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:52.525618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:52.790881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:52.790795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:42:58.217773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:42:58.217732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:05.286769 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:05.286677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:05.388857 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:05.388822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:12.649052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:12.649013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:12.721146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:12.721110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:12.966000 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:12.965958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:13.059991 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:13.059944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:13.220695 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:13.220606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:14.357591 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:14.357552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:14.529201 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:14.529160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:14.652531 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:14.652423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:15.410186 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:15.410081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:15.505859 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:15.505799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:15.605226 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:15.605188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:17.058158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:17.058117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:22.801954 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:22.801912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:22.895278 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:22.895239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:23.500318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:23.500287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:29.583383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:29.583337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:29.656738 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:29.656698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:29.744673 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:29.744637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:29.892121 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:29.892032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:34.231614 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:34.231575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:40.405999 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:40.405957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:43:40.714076 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:43:40.713978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:01.734020 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:01.733970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:08.191365 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:08.191324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:08.290805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:08.290764    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:08.573462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:08.573351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:08.893279 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:08.893121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:09.176789 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:09.176751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:11.377366 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:11.377315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:11.475167 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:11.475135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:11.574647 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:11.574607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:11.724503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:11.724464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:12.116315 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:12.116190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:12.216900 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:12.216862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:15.879543 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:15.879512    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:44:15.884403 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:15.884374    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:44:15.887723 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:15.887697    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:44:15.892753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:15.892726    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:44:15.899931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:15.899895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:16.274013 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.273961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:16.573468 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.573373    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:44:16.574073 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574053    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:44:16.574116 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574079    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="603b1069-6e5c-49f9-8195-490a097bd740" containerName="istio-proxy"
Jul 21 04:44:16.574116 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574106    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.574179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.574179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574129    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.574179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574138    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.574307 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574247    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.574307 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.574259    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c887dc65-f162-4ece-98da-1cb93aa53ac5" containerName="istio-proxy"
Jul 21 04:44:16.577624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.577603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.579976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.579953    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c8ed6c-openshift-default-dockercfg-8fmgj\""
Jul 21 04:44:16.589594 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.589557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:44:16.597388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.597349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:16.717631 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717631 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717852 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.717981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.717973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59tj6\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818764 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59tj6\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.818962 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.818953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819308 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819308 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819308 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819308 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.819782 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.819753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.821720 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.821699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.821872 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.821855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.826812 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.826743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.827040 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.827017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59tj6\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6\") pod \"e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") " pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.892815 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.892773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:16.950198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:16.950152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:17.056247 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.056199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:44:17.058954 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:44:17.058921    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0b8224_ce15_4057_8d97_93bbe76ba5ad.slice/crio-ff0d824ea4ad04c3bcdb24acb8467322ad5e84b5979454387cbfde59e7e8405e WatchSource:0}: Error finding container ff0d824ea4ad04c3bcdb24acb8467322ad5e84b5979454387cbfde59e7e8405e: Status 404 returned error can't find the container with id ff0d824ea4ad04c3bcdb24acb8467322ad5e84b5979454387cbfde59e7e8405e
Jul 21 04:44:17.061136 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.061099    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:17.061313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.061175    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:17.061313 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.061205    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:17.420914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.420874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerStarted","Data":"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"}
Jul 21 04:44:17.421138 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.420934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerStarted","Data":"ff0d824ea4ad04c3bcdb24acb8467322ad5e84b5979454387cbfde59e7e8405e"}
Jul 21 04:44:17.441056 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.440979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podStartSLOduration=1.440951683 podStartE2EDuration="1.440951683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:44:17.438439164 +0000 UTC m=+2406.188489664" watchObservedRunningTime="2026-07-21 04:44:17.440951683 +0000 UTC m=+2406.191002180"
Jul 21 04:44:17.893224 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:17.893123    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:18.898879 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:18.898848    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:19.431627 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:19.431590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:19.432989 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:19.432959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:19.460928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:19.460860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:19.599016 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:19.598982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:19.779617 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:19.779521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:20.222000 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:20.221960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:20.322337 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:20.322281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:20.385314 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:20.385278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:23.731442 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:23.731402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:23.913247 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:23.913176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:32.975567 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:32.975528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:33.080361 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:33.080312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:34.433391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.433300    2578 patch_prober.go:28] interesting pod/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 21 04:44:34.433391 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.433366    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 21 04:44:34.518404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.518307    2578 generic.go:356] "Generic (PLEG): container finished" podID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerID="ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1" exitCode=0
Jul 21 04:44:34.518404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.518395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerDied","Data":"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"}
Jul 21 04:44:34.518849 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.518829    2578 scope.go:117] "RemoveContainer" containerID="ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"
Jul 21 04:44:34.519955 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.519923    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:34.520021 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.520005    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:34.520057 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:34.520044    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:44:35.525838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:35.525795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerStarted","Data":"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"}
Jul 21 04:44:35.893227 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:35.893105    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:35.893521 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:35.893475    2578 patch_prober.go:28] interesting pod/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 21 04:44:35.893639 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:35.893563    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 21 04:44:36.893475 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:36.893432    2578 patch_prober.go:28] interesting pod/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 21 04:44:36.894123 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:36.894085    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 21 04:44:37.894081 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:37.894037    2578 patch_prober.go:28] interesting pod/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 21 04:44:37.894776 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:37.894734    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 21 04:44:38.894072 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:38.894028    2578 patch_prober.go:28] interesting pod/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 21 04:44:38.894428 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:38.894393    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 21 04:44:39.897412 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:39.897370    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:39.897877 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:39.897809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:39.898592 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:39.898570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:44:40.374824 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:40.374783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:41.120840 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:41.120789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:44:41.223992 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:44:41.223954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:01.561498 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:01.561443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:43.810832 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:43.810801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:44.752371 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.752326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:44.872281 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.872239    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"]
Jul 21 04:45:44.876731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.876711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:44.878949 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.878932    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:45:44.884540 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.884434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"]
Jul 21 04:45:44.901139 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:44.901106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd\" (UID: \"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:45.001805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.001761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd\" (UID: \"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:45.002503 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.002449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd\" (UID: \"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:45.190261 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.190193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:45.341953 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.341920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"]
Jul 21 04:45:45.343244 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:45:45.343197    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa58a0c8_0e5a_4ec7_8728_dd21aaee5aa2.slice/crio-8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9 WatchSource:0}: Error finding container 8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9: Status 404 returned error can't find the container with id 8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9
Jul 21 04:45:45.345734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.345610    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:45:45.388668 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.388620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:45.489292 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.489241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:45.901686 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:45.901656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd" event={"ID":"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2","Type":"ContainerStarted","Data":"8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9"}
Jul 21 04:45:47.916618 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:47.916584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd" event={"ID":"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2","Type":"ContainerStarted","Data":"1db3656ba5860aef6ee8b6ba66ab8425f1b09a7b6a1b7f21823e69ce86391dd7"}
Jul 21 04:45:47.934934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:47.934881    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd" podStartSLOduration=1.977850894 podStartE2EDuration="3.934865257s" totalImagesPullingTime="1.957014363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:47.933188933 +0000 UTC m=+2496.683239430" watchObservedRunningTime="2026-07-21 04:45:47.934865257 +0000 UTC m=+2496.684915813"
Jul 21 04:45:48.929838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:48.929801    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" containerID="1db3656ba5860aef6ee8b6ba66ab8425f1b09a7b6a1b7f21823e69ce86391dd7" exitCode=0
Jul 21 04:45:48.930444 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:48.929891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd" event={"ID":"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2","Type":"ContainerDied","Data":"1db3656ba5860aef6ee8b6ba66ab8425f1b09a7b6a1b7f21823e69ce86391dd7"}
Jul 21 04:45:50.075103 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.075079    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:50.146728 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.146695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca\") pod \"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2\" (UID: \"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2\") "
Jul 21 04:45:50.147089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.147068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" (UID: "fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:45:50.247882 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.247790    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2-maas-api-service-ca\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:45:50.942417 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.942392    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"
Jul 21 04:45:50.942417 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.942402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd" event={"ID":"fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2","Type":"ContainerDied","Data":"8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9"}
Jul 21 04:45:50.942626 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:50.942447    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8af679c65d4a72c16f6d64ecf34fbc1550e5c2ddaeab8df83a5255228426d4e9"
Jul 21 04:45:55.339302 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:55.339261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:59.951912 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:59.951866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:45:59.971618 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:59.971581    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"]
Jul 21 04:45:59.974047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:45:59.974021    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628b16-vqdbd"]
Jul 21 04:46:00.425117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:00.425082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:01.781688 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:01.781656    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" path="/var/lib/kubelet/pods/fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2/volumes"
Jul 21 04:46:06.270594 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:06.270510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:06.393530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:06.393497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:06.609710 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:06.609588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:06.831405 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:06.831369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:07.568768 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:07.568731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:07.670668 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:07.670627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:17.463791 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:17.463749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:22.046376 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:22.046335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:22.458773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:22.458715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:28.442767 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:28.442711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:28.606404 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:28.606367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:28.775103 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:28.775007    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:46:28.775345 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:28.775296    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy" containerID="cri-o://f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6" gracePeriod=30
Jul 21 04:46:28.824446 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:28.824397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:29.014947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:29.014894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:29.499096 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:29.499054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:29.728783 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:29.728745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:29.885805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:29.885697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:33.298518 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:33.298480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:33.468579 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:33.468519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:33.629932 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:33.629816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:33.767456 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:33.767421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:34.041166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.041140    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:46:34.072881 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.072847    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.072899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.072941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.072962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.072995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073360 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073360 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59tj6\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073471 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073389    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy\") pod \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\" (UID: \"be0b8224-ce15-4057-8d97-93bbe76ba5ad\") "
Jul 21 04:46:34.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:46:34.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:34.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:34.073772 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073735    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.073868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073773    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-workload-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.073868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073787    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istiod-ca-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.073868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:34.074014 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.073881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:34.075867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.075840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6" (OuterVolumeSpecName: "kube-api-access-59tj6") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "kube-api-access-59tj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:34.076089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.076057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:46:34.076089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.076066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:34.076330 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.076225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be0b8224-ce15-4057-8d97-93bbe76ba5ad" (UID: "be0b8224-ce15-4057-8d97-93bbe76ba5ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:34.174374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174339    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-envoy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.174374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174364    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-podinfo\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.174374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174375    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-credential-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.174374 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174384    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.174721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174392    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0b8224-ce15-4057-8d97-93bbe76ba5ad-istio-data\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.174721 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.174400    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59tj6\" (UniqueName: \"kubernetes.io/projected/be0b8224-ce15-4057-8d97-93bbe76ba5ad-kube-api-access-59tj6\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:46:34.177179 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.177149    2578 generic.go:356] "Generic (PLEG): container finished" podID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerID="f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6" exitCode=0
Jul 21 04:46:34.177344 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.177226    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"
Jul 21 04:46:34.177344 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.177249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerDied","Data":"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"}
Jul 21 04:46:34.177344 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.177319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46" event={"ID":"be0b8224-ce15-4057-8d97-93bbe76ba5ad","Type":"ContainerDied","Data":"ff0d824ea4ad04c3bcdb24acb8467322ad5e84b5979454387cbfde59e7e8405e"}
Jul 21 04:46:34.177511 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.177350    2578 scope.go:117] "RemoveContainer" containerID="f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"
Jul 21 04:46:34.188377 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.188354    2578 scope.go:117] "RemoveContainer" containerID="ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"
Jul 21 04:46:34.196851 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.196833    2578 scope.go:117] "RemoveContainer" containerID="f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"
Jul 21 04:46:34.197107 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:46:34.197089    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6\": container with ID starting with f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6 not found: ID does not exist" containerID="f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"
Jul 21 04:46:34.197146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.197119    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6"} err="failed to get container status \"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6\": rpc error: code = NotFound desc = could not find container \"f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6\": container with ID starting with f56cfaf5e9abb1f7060cd693c73ca4d2c48ee53a9f8237b6bb3ee046604aa1e6 not found: ID does not exist"
Jul 21 04:46:34.197146 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.197137    2578 scope.go:117] "RemoveContainer" containerID="ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"
Jul 21 04:46:34.197385 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:46:34.197367    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1\": container with ID starting with ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1 not found: ID does not exist" containerID="ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"
Jul 21 04:46:34.197433 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.197390    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1"} err="failed to get container status \"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1\": rpc error: code = NotFound desc = could not find container \"ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1\": container with ID starting with ad44fbdbe1b04f4ae99cdc19fa9b8f4a7517e62e5cf235fef170313f6f2a10f1 not found: ID does not exist"
Jul 21 04:46:34.206862 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.206839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:46:34.218780 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.218755    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c8ed6c-openshift-default-548c8b49bf-dpg46"]
Jul 21 04:46:34.490141 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.490057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:34.608019 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:34.607987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:35.781027 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:35.780993    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" path="/var/lib/kubelet/pods/be0b8224-ce15-4057-8d97-93bbe76ba5ad/volumes"
Jul 21 04:46:37.636997 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:37.636959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:38.167353 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.167313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:38.474468 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.474380    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:46:38.474968 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.474944    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.474968 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.474967    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.474982    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.474993    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.475020    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" containerName="revoke-keys"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.475029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" containerName="revoke-keys"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.475129    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.475142 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.475141    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa58a0c8-0e5a-4ec7-8728-dd21aaee5aa2" containerName="revoke-keys"
Jul 21 04:46:38.475496 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.475153    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0b8224-ce15-4057-8d97-93bbe76ba5ad" containerName="istio-proxy"
Jul 21 04:46:38.479880 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.479858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.482437 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.482412    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bccec9-openshift-default-dockercfg-jhfnk\""
Jul 21 04:46:38.494346 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.494318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:46:38.513896 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.513870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514041 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.513901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514041 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.513940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514041 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.513987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.514050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.514066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q6j8\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.514100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514157 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.514136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.514317 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.514159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.523417 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.523387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:38.615117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615117 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615564 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q6j8\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615564 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615564 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615684 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615765 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615828 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.615942 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.616006 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.615943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.617825 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.617803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.618028 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.618012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.624115 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.624094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.625926 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.625905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q6j8\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8\") pod \"e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") " pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.722624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.722582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:38.792125 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.792037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:38.939727 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.939701    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:46:38.941560 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:46:38.941535    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf948190a_e391_487f_92b2_878f6087ef1f.slice/crio-efb48f487e13fadd347984833f9e3bc52da865ac21279a56df3352ebf0870c40 WatchSource:0}: Error finding container efb48f487e13fadd347984833f9e3bc52da865ac21279a56df3352ebf0870c40: Status 404 returned error can't find the container with id efb48f487e13fadd347984833f9e3bc52da865ac21279a56df3352ebf0870c40
Jul 21 04:46:38.943740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.943709    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:38.943819 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.943771    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:38.943819 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:38.943800    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:39.209643 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:39.209605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerStarted","Data":"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"}
Jul 21 04:46:39.209867 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:39.209664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerStarted","Data":"efb48f487e13fadd347984833f9e3bc52da865ac21279a56df3352ebf0870c40"}
Jul 21 04:46:39.230400 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:39.230346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podStartSLOduration=1.230329621 podStartE2EDuration="1.230329621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:46:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:46:39.228029614 +0000 UTC m=+2547.978080111" watchObservedRunningTime="2026-07-21 04:46:39.230329621 +0000 UTC m=+2547.980380118"
Jul 21 04:46:39.792298 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:39.792265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:40.797843 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:40.797809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:41.220975 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.220938    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:41.222029 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.222009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:41.260666 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.260588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:41.355937 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.355896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:41.446816 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.446784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:41.638414 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.638313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:41.898306 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.898202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:41.997740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:41.997679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:45.791388 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:45.791298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:53.296913 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.296881    2578 generic.go:356] "Generic (PLEG): container finished" podID="f948190a-e391-487f-92b2-878f6087ef1f" containerID="ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2" exitCode=0
Jul 21 04:46:53.297378 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.296951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerDied","Data":"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"}
Jul 21 04:46:53.297424 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.297376    2578 scope.go:117] "RemoveContainer" containerID="ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"
Jul 21 04:46:53.298487 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.298447    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:53.298558 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.298530    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:53.298596 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:53.298563    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:46:54.309963 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:54.309914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerStarted","Data":"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"}
Jul 21 04:46:54.541420 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:54.541382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:54.792858 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:54.792814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:54.794182 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:54.794143    2578 patch_prober.go:28] interesting pod/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 04:46:54.794369 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:54.794244    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 04:46:55.793902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:55.793449    2578 patch_prober.go:28] interesting pod/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 04:46:55.793902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:55.793519    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 04:46:56.052410 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:56.052275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:46:56.221088 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:56.221043    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:56.793293 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:56.793251    2578 patch_prober.go:28] interesting pod/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 04:46:56.793505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:56.793330    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 04:46:57.793286 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:57.793246    2578 patch_prober.go:28] interesting pod/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 04:46:57.793907 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:57.793872    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 04:46:58.796661 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:58.796627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:46:58.797734 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:46:58.797715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:47:02.704649 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:02.704610    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:02.805040 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:02.805000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:04.611531 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:04.611491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:04.710564 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:04.710533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:09.865887 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:09.865845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:14.045894 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:14.045854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:14.447874 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:14.447838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:20.327601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:20.327564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:20.394483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:20.394435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:20.624639 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:20.624551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:20.921982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:20.921947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:21.572672 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:21.572634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:21.670365 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:21.670331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:36.572094 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:36.572008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:41.061362 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:41.061320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:41.452713 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:41.452663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:47.300901 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.300867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:47.361159 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.361123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:47.610588 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.610499    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:47:47.610753 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.610721    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy" containerID="cri-o://89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595" gracePeriod=30
Jul 21 04:47:47.634598 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.634546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:47.853646 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:47.853611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:48.207287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:48.207250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:48.524520 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:48.524406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:48.747975 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:48.747933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:51.436764 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:51.436727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:51.541372 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:51.541335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:51.619981 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:51.619940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:51.748012 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:51.747922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:52.101645 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.101566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:52.206206 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.206167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:52.882983 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.882913    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:47:52.971525 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971567    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q6j8\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971943 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971742    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.971943 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:52.971943 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971859    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:52.972102 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972059    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:52.972158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:52.972158 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.971775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.972310 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972230    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo\") pod \"f948190a-e391-487f-92b2-878f6087ef1f\" (UID: \"f948190a-e391-487f-92b2-878f6087ef1f\") "
Jul 21 04:47:52.972490 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:52.972747 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972632    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-data\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:52.972808 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972786    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f948190a-e391-487f-92b2-878f6087ef1f-istiod-ca-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:52.972808 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972801    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:52.972918 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972814    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-workload-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:52.972918 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.972829    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-credential-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:52.974105 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.974070    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8" (OuterVolumeSpecName: "kube-api-access-7q6j8") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "kube-api-access-7q6j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:52.974197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.974125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:52.974197 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.974159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:52.974508 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:52.974494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f948190a-e391-487f-92b2-878f6087ef1f" (UID: "f948190a-e391-487f-92b2-878f6087ef1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:47:53.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.073486    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f948190a-e391-487f-92b2-878f6087ef1f-istio-envoy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:53.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.073517    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q6j8\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-kube-api-access-7q6j8\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:53.073524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.073532    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f948190a-e391-487f-92b2-878f6087ef1f-istio-podinfo\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:53.073760 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.073543    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f948190a-e391-487f-92b2-878f6087ef1f-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:47:53.633725 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.633683    2578 generic.go:356] "Generic (PLEG): container finished" podID="f948190a-e391-487f-92b2-878f6087ef1f" containerID="89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595" exitCode=0
Jul 21 04:47:53.633902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.633739    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"
Jul 21 04:47:53.633902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.633772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerDied","Data":"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"}
Jul 21 04:47:53.633902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.633841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs" event={"ID":"f948190a-e391-487f-92b2-878f6087ef1f","Type":"ContainerDied","Data":"efb48f487e13fadd347984833f9e3bc52da865ac21279a56df3352ebf0870c40"}
Jul 21 04:47:53.633902 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.633866    2578 scope.go:117] "RemoveContainer" containerID="89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"
Jul 21 04:47:53.645375 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.644593    2578 scope.go:117] "RemoveContainer" containerID="ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"
Jul 21 04:47:53.659892 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.659855    2578 scope.go:117] "RemoveContainer" containerID="89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"
Jul 21 04:47:53.660289 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:47:53.660260    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595\": container with ID starting with 89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595 not found: ID does not exist" containerID="89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"
Jul 21 04:47:53.660458 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.660428    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595"} err="failed to get container status \"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595\": rpc error: code = NotFound desc = could not find container \"89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595\": container with ID starting with 89aaafbf01323fa437a76b9a89a9d129d514e452c7a89379e8d88c5fa62ce595 not found: ID does not exist"
Jul 21 04:47:53.660458 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.660460    2578 scope.go:117] "RemoveContainer" containerID="ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"
Jul 21 04:47:53.660852 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:47:53.660827    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2\": container with ID starting with ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2 not found: ID does not exist" containerID="ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"
Jul 21 04:47:53.660963 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.660858    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2"} err="failed to get container status \"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2\": rpc error: code = NotFound desc = could not find container \"ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2\": container with ID starting with ea37bcee74b6b5fd03223767c77752b7c0bb7ab48221791b4f045bebfb7f64e2 not found: ID does not exist"
Jul 21 04:47:53.661582 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.661558    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:47:53.664835 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.664813    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bccec9-openshift-default-55b795fbcf-mfszs"]
Jul 21 04:47:53.781744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:53.781712    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f948190a-e391-487f-92b2-878f6087ef1f" path="/var/lib/kubelet/pods/f948190a-e391-487f-92b2-878f6087ef1f/volumes"
Jul 21 04:47:55.978385 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:55.978349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:56.433367 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.433335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:56.658671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.658640    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:47:56.659323 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.659183    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:47:56.659323 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.659225    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:47:56.659323 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.659245    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:47:56.659323 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.659255    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:47:56.659602 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.659372    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:47:56.662427 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.662404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.664762 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.664741    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cfd2ba-openshift-default-dockercfg-bjz48\""
Jul 21 04:47:56.675198 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.675169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:47:56.690980 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.690888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:56.813876 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.813835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.813890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6dl\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.813952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.813994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.814025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814071 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.814045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.814101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.814182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.814392 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.814280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915411 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6dl\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915610 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.915838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.916051 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.915951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.916051 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.916019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.916275 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.916253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.916275 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.916267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.916409 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.916271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.918084 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.918056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.918355 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.918338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.922804 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.922780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.922940 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.922923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6dl\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl\") pod \"e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") " pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.974366 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.974289    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:56.980275 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:56.980242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:57.121066 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.121037    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:47:57.123849 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:47:57.123822    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ee471e_f87d_4b43_9580_a38d651bb980.slice/crio-ee82bb5057799c1bfed046efce6230d0f249a2e40722f27220c73cf8a29c48a2 WatchSource:0}: Error finding container ee82bb5057799c1bfed046efce6230d0f249a2e40722f27220c73cf8a29c48a2: Status 404 returned error can't find the container with id ee82bb5057799c1bfed046efce6230d0f249a2e40722f27220c73cf8a29c48a2
Jul 21 04:47:57.125960 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.125916    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:47:57.126047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.125984    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:47:57.126047 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.126011    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:47:57.658774 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.658742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerStarted","Data":"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"}
Jul 21 04:47:57.658931 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.658793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerStarted","Data":"ee82bb5057799c1bfed046efce6230d0f249a2e40722f27220c73cf8a29c48a2"}
Jul 21 04:47:57.682445 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.682384    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podStartSLOduration=1.6823631350000001 podStartE2EDuration="1.682363135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:47:57.681858212 +0000 UTC m=+2626.431908713" watchObservedRunningTime="2026-07-21 04:47:57.682363135 +0000 UTC m=+2626.432413634"
Jul 21 04:47:57.975060 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:57.974971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:58.980617 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:58.980583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:59.636188 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:59.636128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:59.669587 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:59.669554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:59.670541 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:59.670517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:47:59.725731 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:59.725698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:47:59.798760 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:47:59.798704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:00.186928 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:00.186889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:00.307770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:00.307730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:00.409944 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:00.409910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:04.164052 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:04.164025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:06.170549 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:06.170504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:06.273259 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:06.273194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:12.882764 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:12.882727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:12.976813 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:12.976775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:13.748070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.748033    2578 generic.go:356] "Generic (PLEG): container finished" podID="28ee471e-f87d-4b43-9580-a38d651bb980" containerID="e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011" exitCode=0
Jul 21 04:48:13.748277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.748100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerDied","Data":"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"}
Jul 21 04:48:13.748596 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.748581    2578 scope.go:117] "RemoveContainer" containerID="e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"
Jul 21 04:48:13.749735 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.749705    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:48:13.749802 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.749774    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:48:13.749856 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:13.749806    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 21 04:48:14.669934 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:14.669894    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:48:14.755356 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:14.755317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerStarted","Data":"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"}
Jul 21 04:48:14.974915 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:14.974826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:48:14.976261 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:14.976198    2578 patch_prober.go:28] interesting pod/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 21 04:48:14.976406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:14.976302    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 21 04:48:15.491320 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:15.491282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:15.547017 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:15.546985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:15.975645 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:15.975598    2578 patch_prober.go:28] interesting pod/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 21 04:48:15.976039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:15.975660    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 21 04:48:16.975744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:16.975703    2578 patch_prober.go:28] interesting pod/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 21 04:48:16.976123 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:16.975763    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 21 04:48:17.614178 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:17.614128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:17.975467 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:17.975422    2578 patch_prober.go:28] interesting pod/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 21 04:48:17.975657 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:17.975511    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 21 04:48:18.979528 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:18.979495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:48:18.979910 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:18.979787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:48:18.980531 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:18.980510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:48:22.174080 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:22.174038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:22.276571 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:22.276531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:28.778578 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:28.778539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:36.876453 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:36.876409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:43.502472 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:43.502428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:48:43.602462 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:48:43.602428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:49:15.913705 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:49:15.913669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:49:15.921399 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:49:15.921370    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:49:15.921582 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:49:15.921432    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:49:15.937024 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:49:15.936994    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:50:11.330740 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:50:11.330704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:50:37.459078 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:50:37.458966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:50:38.469194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:50:38.469156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:50:52.069481 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:50:52.069444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:51:27.197450 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:51:27.197407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:52:07.939982 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:52:07.939896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:52:09.460570 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:52:09.460531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:52:12.107883 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:52:12.107846    2578 scope.go:117] "RemoveContainer" containerID="1db3656ba5860aef6ee8b6ba66ab8425f1b09a7b6a1b7f21823e69ce86391dd7"
Jul 21 04:52:19.175304 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:52:19.175262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:52:49.278625 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:52:49.278589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:06.942266 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:06.942229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:07.046425 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:07.046387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:13.799849 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:13.799810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:13.900475 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:13.900437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:22.926649 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:22.926611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:23.030408 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:23.030360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:28.176907 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:28.176864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:29.233664 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:29.233630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:41.325013 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:41.324933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:48.780976 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:48.780939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:48.885268 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:48.885232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:49.990172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:49.990137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:53:58.568469 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:53:58.568432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:03.245040 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:03.245003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:03.752357 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:03.752326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:09.512911 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:09.512876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:09.573809 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:09.573773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:09.797673 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:09.797591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:10.043111 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:10.043070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:10.661226 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:10.661176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:10.762166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:10.762136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:15.946137 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:15.946111    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:54:15.953525 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:15.953498    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:54:15.961779 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:15.961759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:54:15.968624 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:15.968604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rvqh_4386a61f-d2a9-4e2f-af49-e887e5db76f6/ovn-acl-logging/0.log"
Jul 21 04:54:20.670494 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:20.670461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:25.243236 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:25.243178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:25.654347 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:25.654256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:31.674830 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:31.674796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:31.874483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:31.874429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:31.959827 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:31.959742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:54:31.960628 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:31.960579    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" containerID="cri-o://1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64" gracePeriod=30
Jul 21 04:54:31.980309 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:31.980201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:32.216058 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:32.215976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:33.982436 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:33.982377    2578 patch_prober.go:28] interesting pod/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 04:54:33.982819 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:33.982462    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:54:37.213466 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.213437    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:54:37.234516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.234516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.234516 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234588    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.234743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt6dl\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl\") pod \"28ee471e-f87d-4b43-9580-a38d651bb980\" (UID: \"28ee471e-f87d-4b43-9580-a38d651bb980\") "
Jul 21 04:54:37.235319 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.235053    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-credential-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.236868 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.235974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data" (OuterVolumeSpecName: "istio-data") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:37.238340 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.238276    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:37.239122 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.238627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:54:37.239240 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.239201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:37.241181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.241155    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:54:37.241181 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.241167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl" (OuterVolumeSpecName: "kube-api-access-dt6dl") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "kube-api-access-dt6dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:54:37.241671 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.241650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:37.241770 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.241703    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token" (OuterVolumeSpecName: "istio-token") pod "28ee471e-f87d-4b43-9580-a38d651bb980" (UID: "28ee471e-f87d-4b43-9580-a38d651bb980"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:54:37.335502 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335463    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt6dl\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-kube-api-access-dt6dl\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335502 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335496    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ee471e-f87d-4b43-9580-a38d651bb980-istio-token\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335502 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335505    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-socket\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335502 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335513    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ee471e-f87d-4b43-9580-a38d651bb980-istio-podinfo\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335522    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-envoy\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335530    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-istio-data\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335537    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ee471e-f87d-4b43-9580-a38d651bb980-istiod-ca-cert\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.335773 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.335544    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ee471e-f87d-4b43-9580-a38d651bb980-workload-certs\") on node \"ip-10-0-135-112.ec2.internal\" DevicePath \"\""
Jul 21 04:54:37.800110 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.800080    2578 generic.go:356] "Generic (PLEG): container finished" podID="28ee471e-f87d-4b43-9580-a38d651bb980" containerID="1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64" exitCode=0
Jul 21 04:54:37.800287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.800141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerDied","Data":"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"}
Jul 21 04:54:37.800287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.800148    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"
Jul 21 04:54:37.800287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.800180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j" event={"ID":"28ee471e-f87d-4b43-9580-a38d651bb980","Type":"ContainerDied","Data":"ee82bb5057799c1bfed046efce6230d0f249a2e40722f27220c73cf8a29c48a2"}
Jul 21 04:54:37.800287 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.800202    2578 scope.go:117] "RemoveContainer" containerID="1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"
Jul 21 04:54:37.809054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.809039    2578 scope.go:117] "RemoveContainer" containerID="e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"
Jul 21 04:54:37.816940 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.816916    2578 scope.go:117] "RemoveContainer" containerID="1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"
Jul 21 04:54:37.817277 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:54:37.817195    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64\": container with ID starting with 1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64 not found: ID does not exist" containerID="1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"
Jul 21 04:54:37.817277 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.817262    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64"} err="failed to get container status \"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64\": rpc error: code = NotFound desc = could not find container \"1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64\": container with ID starting with 1d3b615c7bb520f0dc894800a86869cb635f83d6c120f112e2f9661de0d1cd64 not found: ID does not exist"
Jul 21 04:54:37.817426 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.817286    2578 scope.go:117] "RemoveContainer" containerID="e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"
Jul 21 04:54:37.817553 ip-10-0-135-112 kubenswrapper[2578]: E0721 04:54:37.817530    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011\": container with ID starting with e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011 not found: ID does not exist" containerID="e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"
Jul 21 04:54:37.817594 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.817563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011"} err="failed to get container status \"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011\": rpc error: code = NotFound desc = could not find container \"e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011\": container with ID starting with e2434a0f49241ec40d483f18e194571384d0bd3000e1c611b9e202ef981c4011 not found: ID does not exist"
Jul 21 04:54:37.819115 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.819096    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:54:37.823595 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:37.823571    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cfd2ba-openshift-default-779ff7ddf9-fwq9j"]
Jul 21 04:54:38.395166 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:38.395131    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffn4h_05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67/manager/0.log"
Jul 21 04:54:38.523120 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:38.523090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kzpfs_f5047227-9555-47ec-8c22-68003228119a/manager/0.log"
Jul 21 04:54:38.653306 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:38.653205    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9f7f6f8c-q89gb_fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31/manager/0.log"
Jul 21 04:54:38.776978 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:38.776949    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gx85s_ded1d335-55ac-4121-8b0f-8128fa6671ee/server/0.log"
Jul 21 04:54:38.911953 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:38.911925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nv8vc_1c5ac405-7440-435a-a3a0-4d41a92855e9/manager/0.log"
Jul 21 04:54:39.324092 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:39.324015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-vvrmt_8234071d-b6ad-4236-9686-62fc338ea408/copy-manifests/0.log"
Jul 21 04:54:39.341512 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:39.341482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-vvrmt_8234071d-b6ad-4236-9686-62fc338ea408/manager/0.log"
Jul 21 04:54:39.781033 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:39.781002    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" path="/var/lib/kubelet/pods/28ee471e-f87d-4b43-9580-a38d651bb980/volumes"
Jul 21 04:54:40.056543 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:40.056452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fgnnb_c9fcf23d-ee1c-42ea-88da-efa0c66457df/postgres/0.log"
Jul 21 04:54:41.558517 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:41.558482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fs5vj_c08ddc02-5e6d-4467-9bb0-7822dad74855/manager/0.log"
Jul 21 04:54:41.681172 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:41.681137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8l5xz_0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa/manager/0.log"
Jul 21 04:54:41.933533 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:41.933476    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r5n5q_724eefc5-daee-4109-9d4d-84bf1cc87dce/registry-server/0.log"
Jul 21 04:54:42.064698 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:42.064666    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sp6c6_cd07dfb3-8c5b-48ee-b954-72c4c9315983/manager/0.log"
Jul 21 04:54:42.313676 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:42.313572    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ks7b7_12124d16-9431-4949-b519-83c2b676865f/manager/0.log"
Jul 21 04:54:42.935577 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:42.935546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-f76dh_70c447fe-12fb-4b72-8f1d-7112692a580e/kube-auth-proxy/0.log"
Jul 21 04:54:43.181318 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:43.181290    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/1.log"
Jul 21 04:54:43.306947 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:43.306862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kswpp_e9695944-58fc-4a14-a192-5c3586c19e76/payload-pre-processing/0.log"
Jul 21 04:54:43.434314 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:43.434273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6b6qh_d759e102-32f6-492a-87c8-b9b8646958cf/payload-processing/0.log"
Jul 21 04:54:43.921616 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:43.921583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9tmhl_0cae1229-ac9c-4882-8553-cf10ef7f9c44/main/0.log"
Jul 21 04:54:44.293341 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:44.293258    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5mp4h_47988a8b-3c0f-4d8e-a42c-bd7c16e4e139/main/0.log"
Jul 21 04:54:44.412443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:44.412399    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jq9pz_619272b2-520a-493c-a236-26f8fda36613/main/0.log"
Jul 21 04:54:49.943167 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:49.943132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:50.007860 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:50.007825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:54:52.912838 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:52.912805    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5d5vs_9836f108-de52-4f85-a1c3-07bab73386f0/global-pull-secret-syncer/0.log"
Jul 21 04:54:53.048051 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:53.048016    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log"
Jul 21 04:54:53.181483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:53.181361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-112.ec2.internal_1399c85245541448fb6c7788aff95862/haproxy/0.log"
Jul 21 04:54:58.643992 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:58.643910    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fs5vj_c08ddc02-5e6d-4467-9bb0-7822dad74855/manager/0.log"
Jul 21 04:54:58.679089 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:58.679063    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8l5xz_0ac9c764-7fe7-4d09-b36f-dd9a1bd7aefa/manager/0.log"
Jul 21 04:54:58.774826 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:58.774785    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r5n5q_724eefc5-daee-4109-9d4d-84bf1cc87dce/registry-server/0.log"
Jul 21 04:54:58.999665 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:58.999632    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sp6c6_cd07dfb3-8c5b-48ee-b954-72c4c9315983/manager/0.log"
Jul 21 04:54:59.136811 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:54:59.136769    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ks7b7_12124d16-9431-4949-b519-83c2b676865f/manager/0.log"
Jul 21 04:55:01.063884 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.063847    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-787d686c5f-msxpz_c69bffdf-05df-4824-9906-31fe3bdd19f8/metrics-server/0.log"
Jul 21 04:55:01.088383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.088352    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-g7j9t_65d8ec7c-cc6e-465b-b858-53da49843b71/monitoring-plugin/0.log"
Jul 21 04:55:01.117510 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.117427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbcm5_0357f445-8dd5-4db6-a783-7b2b0fcac74b/node-exporter/0.log"
Jul 21 04:55:01.137067 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.137043    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbcm5_0357f445-8dd5-4db6-a783-7b2b0fcac74b/kube-rbac-proxy/0.log"
Jul 21 04:55:01.156383 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.156359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbcm5_0357f445-8dd5-4db6-a783-7b2b0fcac74b/init-textfile/0.log"
Jul 21 04:55:01.420338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.420307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/prometheus/0.log"
Jul 21 04:55:01.440719 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.440692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/config-reloader/0.log"
Jul 21 04:55:01.460601 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.460569    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/thanos-sidecar/0.log"
Jul 21 04:55:01.481572 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.481540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/kube-rbac-proxy-web/0.log"
Jul 21 04:55:01.500905 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.500875    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/kube-rbac-proxy/0.log"
Jul 21 04:55:01.520524 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.520501    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/kube-rbac-proxy-thanos/0.log"
Jul 21 04:55:01.540497 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.540474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1623fbc4-23e2-4888-939e-db50c5d14928/init-config-reloader/0.log"
Jul 21 04:55:01.624273 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:01.624240    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-p7zt7_3e756c27-0589-4e8e-90bf-043858d354ea/prometheus-operator-admission-webhook/0.log"
Jul 21 04:55:03.298755 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.298683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"]
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299093    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299104    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299114    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299119    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299180    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299190    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ee471e-f87d-4b43-9580-a38d651bb980" containerName="istio-proxy"
Jul 21 04:55:03.299194 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.299197    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f948190a-e391-487f-92b2-878f6087ef1f" containerName="istio-proxy"
Jul 21 04:55:03.302443 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.302426    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.305013 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.304992    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mhpnj\"/\"default-dockercfg-xbcnv\""
Jul 21 04:55:03.305249 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.305234    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"kube-root-ca.crt\""
Jul 21 04:55:03.305342 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.305304    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"openshift-service-ca.crt\""
Jul 21 04:55:03.323483 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.323459    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"]
Jul 21 04:55:03.373163 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.373131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-podres\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.373338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.373178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6t6s\" (UniqueName: \"kubernetes.io/projected/a65b4fc0-5506-4baa-861b-d203631b353e-kube-api-access-f6t6s\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.373338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.373199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-proc\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.373338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.373246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-sys\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.373338 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.373260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-lib-modules\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.474744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-podres\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.474744 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6t6s\" (UniqueName: \"kubernetes.io/projected/a65b4fc0-5506-4baa-861b-d203631b353e-kube-api-access-f6t6s\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-proc\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-sys\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-lib-modules\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-podres\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-proc\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.474906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-sys\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.475039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.475023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65b4fc0-5506-4baa-861b-d203631b353e-lib-modules\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.483053 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.483028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6t6s\" (UniqueName: \"kubernetes.io/projected/a65b4fc0-5506-4baa-861b-d203631b353e-kube-api-access-f6t6s\") pod \"perf-node-gather-daemonset-cjbxj\" (UID: \"a65b4fc0-5506-4baa-861b-d203631b353e\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.612356 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.612265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.755396 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.755283    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"]
Jul 21 04:55:03.758264 ip-10-0-135-112 kubenswrapper[2578]: W0721 04:55:03.758201    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda65b4fc0_5506_4baa_861b_d203631b353e.slice/crio-03b32e04cb3e57d2268435c2cf62420969f27835371796b5fca46f572e5ad72a WatchSource:0}: Error finding container 03b32e04cb3e57d2268435c2cf62420969f27835371796b5fca46f572e5ad72a: Status 404 returned error can't find the container with id 03b32e04cb3e57d2268435c2cf62420969f27835371796b5fca46f572e5ad72a
Jul 21 04:55:03.758662 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.758622    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/2.log"
Jul 21 04:55:03.768909 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.768890    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cl9p4_83346093-da8d-43e4-82e1-af27fb1b0591/console-operator/3.log"
Jul 21 04:55:03.941101 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.941053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj" event={"ID":"a65b4fc0-5506-4baa-861b-d203631b353e","Type":"ContainerStarted","Data":"6c2daa2b860956d399c433c6cfac04d6e2a9ce226d9fb8623e419fe4001c1f99"}
Jul 21 04:55:03.941270 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.941121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj" event={"ID":"a65b4fc0-5506-4baa-861b-d203631b353e","Type":"ContainerStarted","Data":"03b32e04cb3e57d2268435c2cf62420969f27835371796b5fca46f572e5ad72a"}
Jul 21 04:55:03.941270 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.941201    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:03.958953 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:03.958903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj" podStartSLOduration=0.95888778 podStartE2EDuration="958.88778ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:55:03.956891079 +0000 UTC m=+3052.706941577" watchObservedRunningTime="2026-07-21 04:55:03.95888778 +0000 UTC m=+3052.708938277"
Jul 21 04:55:06.002821 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:06.002789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czk4f_0776a76e-e7c5-473d-8c8c-d71acc6df211/dns/0.log"
Jul 21 04:55:06.036593 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:06.036558    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czk4f_0776a76e-e7c5-473d-8c8c-d71acc6df211/kube-rbac-proxy/0.log"
Jul 21 04:55:06.105264 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:06.105230    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-25cfk_8b8cbd13-af9a-49c7-a363-6ea13f5f8bf8/dns-node-resolver/0.log"
Jul 21 04:55:06.695914 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:06.695886    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-586645f5c4-5mp66_5bc40118-71ce-4d00-9fd7-3d65fc53c5dd/registry/0.log"
Jul 21 04:55:06.721202 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:06.721174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gsms_ac37dc7e-b446-4e71-a506-8fd157f3a26c/node-ca/0.log"
Jul 21 04:55:07.976522 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:07.976483    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-f76dh_70c447fe-12fb-4b72-8f1d-7112692a580e/kube-auth-proxy/0.log"
Jul 21 04:55:08.031805 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:08.031774    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/0.log"
Jul 21 04:55:08.084325 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:08.084290    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/1.log"
Jul 21 04:55:08.122754 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:08.122721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kswpp_e9695944-58fc-4a14-a192-5c3586c19e76/payload-pre-processing/0.log"
Jul 21 04:55:08.161237 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:08.161178    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6b6qh_d759e102-32f6-492a-87c8-b9b8646958cf/payload-processing/0.log"
Jul 21 04:55:08.920999 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:08.920962    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w42qd_a18c6999-0c76-4110-bfb4-2fc2386aec39/serve-healthcheck-canary/0.log"
Jul 21 04:55:09.571054 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:09.571022    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhw48_92f67ec0-5e04-48f0-8253-d483456ffa07/kube-rbac-proxy/0.log"
Jul 21 04:55:09.590476 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:09.590451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhw48_92f67ec0-5e04-48f0-8253-d483456ffa07/exporter/0.log"
Jul 21 04:55:09.610617 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:09.610592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhw48_92f67ec0-5e04-48f0-8253-d483456ffa07/extractor/0.log"
Jul 21 04:55:09.956154 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:09.956127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-cjbxj"
Jul 21 04:55:11.024908 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:11.024869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:55:11.075192 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:11.075149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5kfhb_c2d3c268-8495-48c9-bc5f-844bd6ae5e4f/konnectivity-agent/0.log" limit=1024
Jul 21 04:55:11.757986 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:11.757958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffn4h_05983b1f-ef2f-4138-a7bb-c5bd8cc8ed67/manager/0.log"
Jul 21 04:55:12.098907 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.098822    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kzpfs_f5047227-9555-47ec-8c22-68003228119a/manager/0.log"
Jul 21 04:55:12.302772 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.302730    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9f7f6f8c-q89gb_fbd522aa-e4f3-4114-ab3b-98ea7b6f1d31/manager/0.log"
Jul 21 04:55:12.323866 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.323838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gx85s_ded1d335-55ac-4121-8b0f-8128fa6671ee/server/0.log"
Jul 21 04:55:12.444257 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.444204    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nv8vc_1c5ac405-7440-435a-a3a0-4d41a92855e9/manager/0.log"
Jul 21 04:55:12.686453 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.686421    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-vvrmt_8234071d-b6ad-4236-9686-62fc338ea408/manager/0.log"
Jul 21 04:55:12.703039 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:12.703015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-vvrmt_8234071d-b6ad-4236-9686-62fc338ea408/copy-manifests/0.log"
Jul 21 04:55:13.738273 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:13.738246    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-f76dh_70c447fe-12fb-4b72-8f1d-7112692a580e/kube-auth-proxy/0.log"
Jul 21 04:55:13.773180 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:13.773144    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/0.log"
Jul 21 04:55:13.829752 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:13.829713    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/1.log"
Jul 21 04:55:13.861070 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:13.861033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kswpp_e9695944-58fc-4a14-a192-5c3586c19e76/payload-pre-processing/0.log"
Jul 21 04:55:13.888409 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:13.888385    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6b6qh_d759e102-32f6-492a-87c8-b9b8646958cf/payload-processing/0.log"
Jul 21 04:55:14.022132 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:14.022047    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fq6hz_887e5ce2-54c2-40e9-bdf6-60925f0ba0de/openshift-lws-operator/0.log"
Jul 21 04:55:15.340980 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:15.340883    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-f76dh_70c447fe-12fb-4b72-8f1d-7112692a580e/kube-auth-proxy/0.log"
Jul 21 04:55:15.379406 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:15.379368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/0.log"
Jul 21 04:55:15.433530 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:15.433493    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bz5xc_6278cca9-031b-4f29-aac3-e3a063643532/istio-proxy/1.log"
Jul 21 04:55:15.466235 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:15.466185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kswpp_e9695944-58fc-4a14-a192-5c3586c19e76/payload-pre-processing/0.log"
Jul 21 04:55:15.494554 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:15.494522    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6b6qh_d759e102-32f6-492a-87c8-b9b8646958cf/payload-processing/0.log"
Jul 21 04:55:18.875834 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:18.875791    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kg8pv_9517e07e-92e3-49b4-9ff7-901d4372d48a/migrator/0.log"
Jul 21 04:55:18.895505 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:18.895469    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kg8pv_9517e07e-92e3-49b4-9ff7-901d4372d48a/graceful-termination/0.log"
Jul 21 04:55:20.517327 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.517297    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/kube-multus-additional-cni-plugins/0.log"
Jul 21 04:55:20.537141 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.537112    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/egress-router-binary-copy/0.log"
Jul 21 04:55:20.556547 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.556516    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/cni-plugins/0.log"
Jul 21 04:55:20.575950 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.575919    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/bond-cni-plugin/0.log"
Jul 21 04:55:20.598077 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.598045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/routeoverride-cni/0.log"
Jul 21 04:55:20.617472 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.617437    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/whereabouts-cni-bincopy/0.log"
Jul 21 04:55:20.636732 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.636704    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tn6br_2a248879-e692-42a9-add8-eaad80c2fffe/whereabouts-cni/0.log"
Jul 21 04:55:20.682621 ip-10-0-135-112 kubenswrapper[2578]: I0721 04:55:20.682588    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gjrmc_b64567ae-1e94-46af-8c68-a17fb113add6/kube-multus/0.log"