Jul 25 01:11:20.976893 ip-10-0-130-23 systemd[1]: Starting Kubernetes Kubelet...
Jul 25 01:11:21.399741 ip-10-0-130-23 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 01:11:21.399741 ip-10-0-130-23 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 25 01:11:21.399741 ip-10-0-130-23 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 01:11:21.399741 ip-10-0-130-23 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 25 01:11:21.399741 ip-10-0-130-23 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 01:11:21.402630 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.402422    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 25 01:11:21.407085 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407059    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.407085 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407083    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407089    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407094    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407098    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407102    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407105    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407108    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407111    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407114    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407117    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407120    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407123    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407126    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407129    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407132    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407135    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407138    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407141    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407145    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.407168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407149    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407153    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407156    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407158    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407162    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407165    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407168    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407171    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407174    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407178    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407182    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407185    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407188    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407191    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407194    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407197    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407200    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407203    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407206    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407209    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.407691 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407211    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407214    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407217    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407219    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407222    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407225    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407227    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407230    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407233    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407236    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407238    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407242    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407245    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407247    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407251    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407255    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407259    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407261    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407264    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407267    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.408214 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407270    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407273    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407276    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407279    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407282    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407284    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407287    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407290    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407293    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407295    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407298    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407301    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407304    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407307    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407309    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407312    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407315    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407317    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407320    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407323    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.408824 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407326    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407329    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407331    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407335    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407339    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407343    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407348    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407351    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407354    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407357    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407360    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407363    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407366    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407369    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407372    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407375    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407378    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407381    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.407385    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.409353 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409126    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409134    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409138    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409142    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409145    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409148    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409151    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409153    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409156    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409159    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409162    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409169    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409172    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409175    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409178    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409181    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409184    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409187    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409190    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409193    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.409878 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409196    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409199    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409202    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409204    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409207    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409210    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409213    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409217    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409221    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409231    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409234    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409237    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409240    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409242    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409245    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409248    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409252    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409256    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409260    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.410414 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409263    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409267    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409270    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409276    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409283    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409287    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409289    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409292    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409295    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409298    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409301    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409304    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409307    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409312    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409315    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409318    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409322    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409325    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409328    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409331    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.410951 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409334    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409337    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409340    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409351    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409354    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409357    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409360    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409363    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409366    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409369    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409372    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409374    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409377    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409380    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409384    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409386    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409391    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409394    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409397    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.411650 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409399    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409402    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409405    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409407    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409410    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409413    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409415    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409418    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409421    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409423    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409426    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409429    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409431    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409434    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409437    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409440    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409442    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409451    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409454    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409457    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.412167 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.409460    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410030    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410037    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410041    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410044    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410048    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410051    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410054    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410057    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410061    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410064    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410067    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410070    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410073    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410076    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410079    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410082    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410085    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410088    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.412712 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410090    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410093    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410096    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410099    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410101    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410104    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410107    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410110    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410112    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410115    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410124    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410128    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410131    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410134    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410137    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410139    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410142    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410144    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410147    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410150    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.413223 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410153    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410155    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410159    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410162    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410164    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410167    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410170    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410173    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410176    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410178    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410181    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410184    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410186    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410189    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410192    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410195    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410199    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410203    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410206    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.413763 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410211    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410214    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410217    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410220    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410229    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410233    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410237    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410240    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410244    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410247    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410250    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410253    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410256    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410259    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410262    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410265    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410268    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410271    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410273    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410276    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.414298 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410279    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410282    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410286    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410288    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410291    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410294    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410296    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410299    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410302    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410304    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410307    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410310    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410313    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410315    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410318    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410321    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410324    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410333    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410336    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410338    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.414859 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410341    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.410344    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410425    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410434    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410449    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410454    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410458    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410464    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410478    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410483    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410487    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410490    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410494    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410498    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410501    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410505    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410508    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410511    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410514    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410518    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410528    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410531    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410534    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410538    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 25 01:11:21.415396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410542    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410546    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410550    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410554    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410558    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410562    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410572    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410575    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410592    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410597    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410602    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410605    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410609    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410612    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410616    2565 flags.go:64] FLAG: --enable-server="true"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410621    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410629    2565 flags.go:64] FLAG: --event-burst="100"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410633    2565 flags.go:64] FLAG: --event-qps="50"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410636    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410640    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410644    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410647    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410651    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410654    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410658    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 25 01:11:21.416043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410661    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410664    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410667    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410670    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410674    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410677    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410680    2565 flags.go:64] FLAG: --feature-gates=""
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410685    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410688    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410692    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410696    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410699    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410703    2565 flags.go:64] FLAG: --help="false"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410706    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410715    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410719    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410722    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410726    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410730    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410733    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410736    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410739    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410744    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 25 01:11:21.416730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410747    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410751    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410754    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410758    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410761    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410764    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410767    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410771    2565 flags.go:64] FLAG: --lock-file=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410774    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410777    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410781    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410787    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410790    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410793    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410797    2565 flags.go:64] FLAG: --logging-format="text"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410800    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410804    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410807    2565 flags.go:64] FLAG: --manifest-url=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410810    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410818    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410821    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410826    2565 flags.go:64] FLAG: --max-pods="110"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410830    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410833    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410848    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 25 01:11:21.417376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410852    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410855    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410858    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410862    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410871    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410874    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410879    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410883    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410886    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410893    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410897    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410901    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410904    2565 flags.go:64] FLAG: --port="10250"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410907    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410911    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a8f172e47ac5f7f"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410915    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410918    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410921    2565 flags.go:64] FLAG: --register-node="true"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410925    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410929    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410932    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410936    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410939    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410948    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410952    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 25 01:11:21.418105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410955    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410960    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410964    2565 flags.go:64] FLAG: --runonce="false"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410968    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410971    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410975    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410978    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410988    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410992    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410995    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.410999    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411002    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411006    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411009    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411013    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411017    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411028    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411032    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411038    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411042    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411045    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411053    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411057    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411060    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411064    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 25 01:11:21.418990 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411067    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411070    2565 flags.go:64] FLAG: --v="2"
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411075    2565 flags.go:64] FLAG: --version="false"
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411080    2565 flags.go:64] FLAG: --vmodule=""
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411084    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411088    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411289    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411296    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411301    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411304    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411307    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411311    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411314    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411317    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411320    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411332    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411335    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411338    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411341    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411344    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411346    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.420012 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411351    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411355    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411357    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411360    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411363    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411366    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411369    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411372    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411374    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411377    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411380    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411383    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411385    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411388    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411391    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411394    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411397    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411400    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411402    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411407    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.420578 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411409    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411414    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411418    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411422    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411425    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411429    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411431    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411440    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411443    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411446    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411449    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411452    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411456    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411459    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411462    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411466    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411470    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411474    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.421133 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411477    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411480    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411483    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411485    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411488    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411491    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411494    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411497    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411500    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411502    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411505    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411508    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411511    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411515    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411518    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411520    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411523    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411526    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411528    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411531    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.421642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411534    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411537    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411546    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411549    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411552    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411555    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411560    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411563    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411565    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411568    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411572    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411574    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411577    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411599    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411603    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411606    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411608    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411611    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411614    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411618    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.422168 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411621    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411624    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411627    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411630    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411633    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.411640    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.411646    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.421403    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.421427    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.421452    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.421459    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421537    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421547    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.422716 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421551    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421554    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421558    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421561    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421565    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421568    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421571    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421574    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421577    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421580    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421597    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421602    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421605    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421609    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421612    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421615    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421619    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421623    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421626    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421629    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.423125 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421633    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421636    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421640    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421645    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421648    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421652    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421656    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421660    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421663    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421666    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421670    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421673    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421676    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421678    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421681    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421684    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421688    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421691    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421694    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421697    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.423671 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421700    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421703    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421706    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421709    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421711    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421714    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421718    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421721    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421723    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421726    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421729    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421732    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421734    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421737    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421740    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421743    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421746    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421749    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421752    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421755    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.424218 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421758    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421761    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421764    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421767    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421770    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421774    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421778    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421781    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421785    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421787    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421790    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421793    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421796    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421799    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421803    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421807    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421811    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421814    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421818    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.424782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421821    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421823    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421826    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421829    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421832    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421834    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421837    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421840    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421842    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421846    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421849    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421853    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421855    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421858    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421861    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421864    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.425291 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.421867    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.421873    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422024    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422031    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422034    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422037    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422040    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422043    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422046    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422049    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422052    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422055    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422058    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422060    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422064    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 01:11:21.425812 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422068    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422070    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422073    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422076    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422079    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422082    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422085    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422088    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422090    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422093    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422096    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422100    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422104    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422109    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422113    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422116    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422120    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422123    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422126    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 01:11:21.426210 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422128    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422131    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422134    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422137    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422139    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422142    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422145    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422148    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422151    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422154    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422156    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422159    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422163    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422166    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422169    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422172    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422175    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422179    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422182    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422185    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 01:11:21.426748 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422188    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422191    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422194    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422196    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422199    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422202    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422204    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422208    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422210    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422213    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422216    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422219    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422221    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422225    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422228    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422231    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422234    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422236    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422239    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422242    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 01:11:21.427272 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422245    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422247    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422250    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422253    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422256    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422259    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422266    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422269    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422272    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422275    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422277    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422280    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422283    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422286    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422289    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422291    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422294    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422297    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422300    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422303    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 01:11:21.427816 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422305    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422308    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422311    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422314    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422318    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422322    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:21.422326    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.422332    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.422476    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.425676    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.427228    2565 server.go:1019] "Starting client certificate rotation"
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.427346    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 25 01:11:21.428395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.427391    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 25 01:11:21.430651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.430630    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 25 01:11:21.435073 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.435050    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 25 01:11:21.446389 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.446358    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 25 01:11:21.449105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.449088    2565 log.go:25] "Validated CRI v1 image API"
Jul 25 01:11:21.451657 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.451633    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 25 01:11:21.454348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.454321    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8cf84e79-49c9-4638-b49c-2912a130476b:/dev/nvme0n1p3 b1320467-b2eb-48e7-9b1d-81062fd388ee:/dev/nvme0n1p4]
Jul 25 01:11:21.454472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.454344    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 25 01:11:21.457343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.457314    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 25 01:11:21.462435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.462301    2565 manager.go:216] Machine: {Timestamp:2026-07-25 01:11:21.460846941 +0000 UTC m=+0.363491947 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3040408 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab572142869d93446e8760e984037 SystemUUID:ec2ab572-1428-69d9-3446-e8760e984037 BootID:b5558cb4-0cc7-4de9-a729-9272589b8db3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:fd:88:e9:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:fd:88:e9:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:eb:cd:f1:8f:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 25 01:11:21.462435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.462426    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 25 01:11:21.462554 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.462533    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 25 01:11:21.465633 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.465600    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 25 01:11:21.465792 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.465636    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 25 01:11:21.466577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.466564    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 25 01:11:21.466631 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.466578    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 25 01:11:21.466631 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.466602    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 25 01:11:21.468196 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.468154    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 25 01:11:21.469028 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.469015    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 25 01:11:21.472004 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.471989    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 25 01:11:21.472149 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472138    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 25 01:11:21.472186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472175    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 25 01:11:21.472219 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472190    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 25 01:11:21.472219 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472207    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 25 01:11:21.472280 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472220    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 25 01:11:21.472280 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472232    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 25 01:11:21.472739 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472724    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 25 01:11:21.472810 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.472744    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 25 01:11:21.475531 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.475490    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 25 01:11:21.477792 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.477766    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 25 01:11:21.477900 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.477821    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 25 01:11:21.479656 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479643    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 25 01:11:21.479695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479663    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 25 01:11:21.479695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479671    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 25 01:11:21.479695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479678    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 25 01:11:21.479695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479690    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479700    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479710    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479716    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479728    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479734    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479744    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 25 01:11:21.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.479760    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 25 01:11:21.480812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.480798    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 25 01:11:21.480858 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.480813    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 25 01:11:21.482646 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.482601    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 25 01:11:21.482751 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.482726    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 25 01:11:21.482827 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.482804    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 25 01:11:21.484495 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.484473    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldwqj"
Jul 25 01:11:21.484969 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.484952    2565 server.go:1268] "Started kubelet"
Jul 25 01:11:21.485119 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.485073    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 25 01:11:21.485216 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.485108    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 25 01:11:21.485278 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.485253    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 25 01:11:21.486151 ip-10-0-130-23 systemd[1]: Started Kubernetes Kubelet.
Jul 25 01:11:21.488631 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.488616    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 25 01:11:21.490619 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.490566    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldwqj"
Jul 25 01:11:21.491020 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.490986    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 25 01:11:21.492298 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.492261    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 25 01:11:21.495722 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.494485    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-23.ec2.internal.18c5632f26a04407  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-23.ec2.internal,UID:ip-10-0-130-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-23.ec2.internal,},FirstTimestamp:2026-07-25 01:11:21.484919815 +0000 UTC m=+0.387564820,LastTimestamp:2026-07-25 01:11:21.484919815 +0000 UTC m=+0.387564820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-23.ec2.internal,}"
Jul 25 01:11:21.498131 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.498112    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 25 01:11:21.498229 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.498165    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 25 01:11:21.498492 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.498331    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.499001 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.498983    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 25 01:11:21.499078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499014    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 25 01:11:21.499078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499048    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 25 01:11:21.499210 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499195    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 25 01:11:21.499210 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499208    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 25 01:11:21.499426 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499405    2565 factory.go:55] Registering systemd factory
Jul 25 01:11:21.499426 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499428    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 25 01:11:21.499763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499746    2565 factory.go:153] Registering CRI-O factory
Jul 25 01:11:21.499763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499767    2565 factory.go:223] Registration of the crio container factory successfully
Jul 25 01:11:21.499877 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499828    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 25 01:11:21.499877 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499855    2565 factory.go:103] Registering Raw factory
Jul 25 01:11:21.499877 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.499873    2565 manager.go:1196] Started watching for new ooms in manager
Jul 25 01:11:21.500763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.500744    2565 manager.go:349] Starting recovery of all containers
Jul 25 01:11:21.501216 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.501193    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:21.504414 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.504392    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-23.ec2.internal\" not found" node="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.511871 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.511731    2565 manager.go:354] Recovery completed
Jul 25 01:11:21.516770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.516753    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.518913 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.518895    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.519008 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.518928    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.519008 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.518943    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.519464 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.519450    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 25 01:11:21.519464 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.519462    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 25 01:11:21.519612 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.519473    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.519612 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.519484    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 25 01:11:21.520335 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.520318    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.520335 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.520354    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.520490 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.520364    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.522252 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.522238    2565 policy_none.go:49] "None policy: Start"
Jul 25 01:11:21.522314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.522255    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 25 01:11:21.522314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.522267    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 25 01:11:21.524375 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.524362    2565 policy_none.go:47] "Start"
Jul 25 01:11:21.561313 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.561287    2565 manager.go:337] "Starting Device Plugin manager"
Jul 25 01:11:21.561467 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.561348    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 25 01:11:21.561467 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.561364    2565 server.go:87] "Starting device plugin registration server"
Jul 25 01:11:21.561703 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.561684    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 25 01:11:21.561821 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.561700    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 25 01:11:21.562127 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.562104    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 25 01:11:21.562379 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.562219    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 25 01:11:21.562379 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.562232    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 25 01:11:21.562727 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.562704    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 25 01:11:21.562809 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.562789    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.637378 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.637324    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 25 01:11:21.639660 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.638728    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 25 01:11:21.639660 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.638771    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 25 01:11:21.639660 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.638800    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 25 01:11:21.639660 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.638843    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 25 01:11:21.641501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.641479    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:21.662026 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.661982    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.663119 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.663098    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.663215 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.663132    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.663215 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.663143    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.663215 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.663169    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.672289 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.672265    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.672377 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.672297    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-23.ec2.internal\": node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.701661 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.701628    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.739739 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.739654    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"]
Jul 25 01:11:21.739879 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.739749    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.740935 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.740906    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.741090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.740941    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.741090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.740958    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.743548 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.743510    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.743676 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.743658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.743737 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.743701    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.744460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744438    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.744529 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744476    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.744529 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744488    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.744627 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744438    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.744627 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744565    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.744627 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.744579    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.747091 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.747072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.747212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.747103    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 01:11:21.747978 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.747960    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:11:21.748089 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.747990    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:11:21.748089 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.748001    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:11:21.776638 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.776603    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-23.ec2.internal\" not found" node="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.781684 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.781660    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-23.ec2.internal\" not found" node="ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.801793 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.801761    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.801888 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.801814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f46803104cb5b369c0e7545cf31f48-config\") pod \"kube-apiserver-proxy-ip-10-0-130-23.ec2.internal\" (UID: \"79f46803104cb5b369c0e7545cf31f48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.801888 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.801844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.801888 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.801863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902166 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:21.902112    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:21.902356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f46803104cb5b369c0e7545cf31f48-config\") pod \"kube-apiserver-proxy-ip-10-0-130-23.ec2.internal\" (UID: \"79f46803104cb5b369c0e7545cf31f48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f46803104cb5b369c0e7545cf31f48-config\") pod \"kube-apiserver-proxy-ip-10-0-130-23.ec2.internal\" (UID: \"79f46803104cb5b369c0e7545cf31f48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:21.902589 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:21.902340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf40419e430fb8f1db521dd8dfa6303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal\" (UID: \"7bf40419e430fb8f1db521dd8dfa6303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:22.002429 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.002322    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.084873 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.084846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:22.084873 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.084845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:22.102612 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.102574    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.203400 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.203337    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.304169 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.304071    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.404641 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.404603    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.426615 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.426572    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 25 01:11:22.426777 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.426757    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 25 01:11:22.426830 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.426788    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 25 01:11:22.496663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.496607    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-24 01:06:22 +0000 UTC" deadline="2028-01-06 00:39:47.567822958 +0000 UTC"
Jul 25 01:11:22.496663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.496648    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12719h28m25.071178564s"
Jul 25 01:11:22.504698 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:22.504671    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-23.ec2.internal\" not found"
Jul 25 01:11:22.539755 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.539724    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:22.598737 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.598662    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:22.614871 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.614837    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 25 01:11:22.617208 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.617187    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal"
Jul 25 01:11:22.625742 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.625713    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 25 01:11:22.670662 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:22.670619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf40419e430fb8f1db521dd8dfa6303.slice/crio-434df281da623da7ce4ee6c61a3019dfd7ee6de51bfd1fc10897606574afcc33 WatchSource:0}: Error finding container 434df281da623da7ce4ee6c61a3019dfd7ee6de51bfd1fc10897606574afcc33: Status 404 returned error can't find the container with id 434df281da623da7ce4ee6c61a3019dfd7ee6de51bfd1fc10897606574afcc33
Jul 25 01:11:22.673596 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:22.673554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f46803104cb5b369c0e7545cf31f48.slice/crio-09b1ffd92db4895407f15b9f182616517cdecab982e86f27e66d1aa251239fa2 WatchSource:0}: Error finding container 09b1ffd92db4895407f15b9f182616517cdecab982e86f27e66d1aa251239fa2: Status 404 returned error can't find the container with id 09b1ffd92db4895407f15b9f182616517cdecab982e86f27e66d1aa251239fa2
Jul 25 01:11:22.676478 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.676221    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:11:22.686429 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:22.686400    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:23.473452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.473406    2565 apiserver.go:52] "Watching apiserver"
Jul 25 01:11:23.478630 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.478601    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 25 01:11:23.482323 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.481939    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qwbzb","kube-system/global-pull-secret-syncer-lgctr","kube-system/konnectivity-agent-4tltl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g","openshift-cluster-node-tuning-operator/tuned-rqndk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal","openshift-network-operator/iptables-alerter-sc2mf","kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal","openshift-dns/node-resolver-bnx62","openshift-image-registry/node-ca-dqkjz","openshift-multus/multus-additional-cni-plugins-5l4zv","openshift-multus/multus-b88r8","openshift-multus/network-metrics-daemon-s4tph","openshift-network-diagnostics/network-check-target-8qwmp"]
Jul 25 01:11:23.485455 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.485426    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.487647 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.487619    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.487796 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.487727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5wvsp\""
Jul 25 01:11:23.487796 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.487621    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.489213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.487952    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 25 01:11:23.489213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.488108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.489213 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.488207    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:23.490855 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.490460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.492743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.492410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 25 01:11:23.492743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.492547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9kw9r\""
Jul 25 01:11:23.492743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.492707    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 25 01:11:23.493119 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.493099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.495008 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.494834    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.495435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.495189    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gj7pg\""
Jul 25 01:11:23.495435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.495322    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.495664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.495554    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 25 01:11:23.495734 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.495695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.497800    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.498028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kfkrs\""
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.498263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.498425    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.498527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:23.498833 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.498615    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:23.500663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.500638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.502812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.502789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.502919 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.502826    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4msrs\""
Jul 25 01:11:23.503226 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.503199    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.504451 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.504429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.506703 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.506634    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sw9bt\""
Jul 25 01:11:23.506703 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.506666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 25 01:11:23.506903 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.506733    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.507035 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.507014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 25 01:11:23.507108 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.507089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 25 01:11:23.507240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.507221    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 25 01:11:23.507240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.507028    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.507357 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.507317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.507414 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.507395    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:23.510245 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.509667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.510348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-run\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-lib-modules\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510510 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-kubernetes\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510510 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-conf\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510510 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-systemd\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.510510 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.510802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjm4\" (UniqueName: \"kubernetes.io/projected/076f2124-dedc-4afa-8803-4d58cc41740f-kube-api-access-kzjm4\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.510802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-agent-certs\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.510802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-konnectivity-ca\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.510802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-hosts-file\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.510694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dgnx\" (UniqueName: \"kubernetes.io/projected/9bc3e353-5005-4d91-9a8c-e93d7d959db6-kube-api-access-7dgnx\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-registration-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-device-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-sys-fs\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9qz\" (UniqueName: \"kubernetes.io/projected/9f47eaa5-0859-40b6-a4df-3b2c764a6577-kube-api-access-xq9qz\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.511431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-sys\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-var-lib-kubelet\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wgk\" (UniqueName: \"kubernetes.io/projected/1ae63b32-6345-4e08-a39f-d8064cb18883-kube-api-access-l8wgk\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-socket-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc3e353-5005-4d91-9a8c-e93d7d959db6-host-slash\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-tmp\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-modprobe-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysconfig\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-tuned\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511798    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-tmp-dir\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l9sl\" (UniqueName: \"kubernetes.io/projected/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-kube-api-access-9l9sl\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc3e353-5005-4d91-9a8c-e93d7d959db6-iptables-alerter-script\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.511944 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.511926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-host\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.512813 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.512174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.512813 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.512649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9mw9\""
Jul 25 01:11:23.513085 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.513069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.514411 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.514385    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 25 01:11:23.514811 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.514789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 25 01:11:23.515205 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8k95n\""
Jul 25 01:11:23.515419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.515482 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 25 01:11:23.515690 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515671    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 25 01:11:23.515961 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515938    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 25 01:11:23.516083 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.515975    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 25 01:11:23.517142 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.517102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 25 01:11:23.517523 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.517354    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cslc9\""
Jul 25 01:11:23.539794 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.539761    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7pnzd"
Jul 25 01:11:23.554793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.554115    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7pnzd"
Jul 25 01:11:23.580392 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.580046    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:23.600498 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.600450    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 25 01:11:23.613078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.612976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-tmp-dir\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.613078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l9sl\" (UniqueName: \"kubernetes.io/projected/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-kube-api-access-9l9sl\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.613409 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc3e353-5005-4d91-9a8c-e93d7d959db6-iptables-alerter-script\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.613499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-host\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.613499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.613499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-conf-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-host\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-run\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-tmp-dir\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-lib-modules\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.613682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-k8s-cni-cncf-io\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-run\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-kubernetes\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-lib-modules\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-conf\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-kubernetes\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjm4\" (UniqueName: \"kubernetes.io/projected/076f2124-dedc-4afa-8803-4d58cc41740f-kube-api-access-kzjm4\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-systemd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-konnectivity-ca\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.613992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-host\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-netns\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc3e353-5005-4d91-9a8c-e93d7d959db6-iptables-alerter-script\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.614086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-systemd-units\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-conf\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-bin\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-registration-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-konnectivity-ca\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-device-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-registration-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.614757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-netd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-device-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-sys\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-hostroot\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-sys\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc3e353-5005-4d91-9a8c-e93d7d959db6-host-slash\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-tmp\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc3e353-5005-4d91-9a8c-e93d7d959db6-host-slash\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-modprobe-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.614998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysconfig\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-tuned\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysconfig\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-kubelet-config\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-kubelet\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-etc-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615227    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-script-lib\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.615268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/01c0f478-fb7f-47b6-8712-daab3dfbcba7-kube-api-access-dlg99\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-system-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-cnibin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-etc-kubernetes\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctzf\" (UniqueName: \"kubernetes.io/projected/1190a043-2288-430b-9c28-9f203e6a1070-kube-api-access-4ctzf\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-cnibin\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9t4\" (UniqueName: \"kubernetes.io/projected/131387d4-83e4-45bf-8339-91815f154788-kube-api-access-zg9t4\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.615626    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-socket-dir-parent\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-multus-daemon-config\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-modprobe-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-var-lib-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-systemd\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-sysctl-d\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.616147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-bin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-log-socket\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.615904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-systemd\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.616028    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:24.115986521 +0000 UTC m=+3.018631531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-config\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-os-release\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-agent-certs\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-dbus\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qcp\" (UniqueName: \"kubernetes.io/projected/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-kube-api-access-g4qcp\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-os-release\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-slash\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-env-overrides\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-hosts-file\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.617104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dgnx\" (UniqueName: \"kubernetes.io/projected/9bc3e353-5005-4d91-9a8c-e93d7d959db6-kube-api-access-7dgnx\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-sys-fs\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-multus-certs\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9qz\" (UniqueName: \"kubernetes.io/projected/9f47eaa5-0859-40b6-a4df-3b2c764a6577-kube-api-access-xq9qz\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-var-lib-kubelet\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wgk\" (UniqueName: \"kubernetes.io/projected/1ae63b32-6345-4e08-a39f-d8064cb18883-kube-api-access-l8wgk\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-socket-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-serviceca\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-node-log\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovn-node-metrics-cert\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-cni-binary-copy\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-multus\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-kubelet\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-netns\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.617976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-ovn\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.616863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.617248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-hosts-file\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.617563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.617620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ae63b32-6345-4e08-a39f-d8064cb18883-var-lib-kubelet\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.617646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-sys-fs\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.618804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.617775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/076f2124-dedc-4afa-8803-4d58cc41740f-socket-dir\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.619865 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.619836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-tmp\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.620109 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.620078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f3f8c6-fd93-4d5f-961a-f840ed529a6d-agent-certs\") pod \"konnectivity-agent-4tltl\" (UID: \"30f3f8c6-fd93-4d5f-961a-f840ed529a6d\") " pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.620648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.620628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ae63b32-6345-4e08-a39f-d8064cb18883-etc-tuned\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.635907 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.635869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l9sl\" (UniqueName: \"kubernetes.io/projected/5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291-kube-api-access-9l9sl\") pod \"node-resolver-bnx62\" (UID: \"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291\") " pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.637556 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.637525    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:23.637556 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.637557    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:23.637794 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.637575    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:23.637794 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.637662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:24.137638666 +0000 UTC m=+3.040283675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:23.638248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.638169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjm4\" (UniqueName: \"kubernetes.io/projected/076f2124-dedc-4afa-8803-4d58cc41740f-kube-api-access-kzjm4\") pod \"aws-ebs-csi-driver-node-ktt9g\" (UID: \"076f2124-dedc-4afa-8803-4d58cc41740f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.638487 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.638465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dgnx\" (UniqueName: \"kubernetes.io/projected/9bc3e353-5005-4d91-9a8c-e93d7d959db6-kube-api-access-7dgnx\") pod \"iptables-alerter-sc2mf\" (UID: \"9bc3e353-5005-4d91-9a8c-e93d7d959db6\") " pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.641425 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.641397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9qz\" (UniqueName: \"kubernetes.io/projected/9f47eaa5-0859-40b6-a4df-3b2c764a6577-kube-api-access-xq9qz\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:23.644549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.644480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal" event={"ID":"79f46803104cb5b369c0e7545cf31f48","Type":"ContainerStarted","Data":"09b1ffd92db4895407f15b9f182616517cdecab982e86f27e66d1aa251239fa2"}
Jul 25 01:11:23.645314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.645057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wgk\" (UniqueName: \"kubernetes.io/projected/1ae63b32-6345-4e08-a39f-d8064cb18883-kube-api-access-l8wgk\") pod \"tuned-rqndk\" (UID: \"1ae63b32-6345-4e08-a39f-d8064cb18883\") " pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.646296 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.646131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal" event={"ID":"7bf40419e430fb8f1db521dd8dfa6303","Type":"ContainerStarted","Data":"434df281da623da7ce4ee6c61a3019dfd7ee6de51bfd1fc10897606574afcc33"}
Jul 25 01:11:23.717979 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.717931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-kubelet-config\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.717979 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.717985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-kubelet\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-etc-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-etc-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-kubelet-config\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-kubelet\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-script-lib\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/01c0f478-fb7f-47b6-8712-daab3dfbcba7-kube-api-access-dlg99\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-system-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-cnibin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-etc-kubernetes\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctzf\" (UniqueName: \"kubernetes.io/projected/1190a043-2288-430b-9c28-9f203e6a1070-kube-api-access-4ctzf\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-cnibin\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9t4\" (UniqueName: \"kubernetes.io/projected/131387d4-83e4-45bf-8339-91815f154788-kube-api-access-zg9t4\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-socket-dir-parent\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-multus-daemon-config\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-var-lib-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-bin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-log-socket\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-config\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-os-release\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-etc-kubernetes\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-log-socket\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.718687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-os-release\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-cnibin\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-dbus\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qcp\" (UniqueName: \"kubernetes.io/projected/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-kube-api-access-g4qcp\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-os-release\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-slash\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-slash\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-socket-dir-parent\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-script-lib\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-bin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-system-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.718974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-env-overrides\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-cnibin\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-multus-certs\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-var-lib-openvswitch\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-serviceca\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovnkube-config\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-node-log\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d442b8-e39e-4173-a424-36af1e358299-dbus\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-node-log\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovn-node-metrics-cert\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-os-release\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-cni-binary-copy\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-multus\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-kubelet\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-multus-daemon-config\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-netns\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-ovn\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-multus-certs\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-kubelet\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-var-lib-cni-multus\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-serviceca\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-run-netns\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.719930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1190a043-2288-430b-9c28-9f203e6a1070-cni-binary-copy\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.720862 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.720862 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.720862 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.719991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-conf-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.720862 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.720020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.721116 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.720048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.721178 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-k8s-cni-cncf-io\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.721228 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-systemd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.721266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.721298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-host\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.721332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-netns\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.721367 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-systemd-units\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.721401 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-bin\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.721436 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.721472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:23.721472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-netd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.721558 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-hostroot\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.721623 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-conf-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.721688 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.721688 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-k8s-cni-cncf-io\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.721855 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-host\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.721916 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01c0f478-fb7f-47b6-8712-daab3dfbcba7-env-overrides\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.721979 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.721900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.722347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-systemd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.722463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-run-ovn\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.722463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-multus-cni-dir\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.722463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-host-run-netns\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.722648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-netd\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.722648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/131387d4-83e4-45bf-8339-91815f154788-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.722648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-systemd-units\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.722648 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.722616    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:23.722648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.722637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01c0f478-fb7f-47b6-8712-daab3dfbcba7-host-cni-bin\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.722852 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:23.722698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:24.222679447 +0000 UTC m=+3.125324439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:23.723054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.723026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01c0f478-fb7f-47b6-8712-daab3dfbcba7-ovn-node-metrics-cert\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.723188 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.723035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1190a043-2288-430b-9c28-9f203e6a1070-hostroot\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.723253 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.723199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.723306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.723250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/131387d4-83e4-45bf-8339-91815f154788-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.736508 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.736402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/01c0f478-fb7f-47b6-8712-daab3dfbcba7-kube-api-access-dlg99\") pod \"ovnkube-node-qwbzb\" (UID: \"01c0f478-fb7f-47b6-8712-daab3dfbcba7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.736508 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.736403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qcp\" (UniqueName: \"kubernetes.io/projected/dd6f88d7-a032-4f0e-a320-a7fac3cc187b-kube-api-access-g4qcp\") pod \"node-ca-dqkjz\" (UID: \"dd6f88d7-a032-4f0e-a320-a7fac3cc187b\") " pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.736891 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.736866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9t4\" (UniqueName: \"kubernetes.io/projected/131387d4-83e4-45bf-8339-91815f154788-kube-api-access-zg9t4\") pod \"multus-additional-cni-plugins-5l4zv\" (UID: \"131387d4-83e4-45bf-8339-91815f154788\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.736997 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.736970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctzf\" (UniqueName: \"kubernetes.io/projected/1190a043-2288-430b-9c28-9f203e6a1070-kube-api-access-4ctzf\") pod \"multus-b88r8\" (UID: \"1190a043-2288-430b-9c28-9f203e6a1070\") " pod="openshift-multus/multus-b88r8"
Jul 25 01:11:23.801681 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.801637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sc2mf"
Jul 25 01:11:23.819768 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.819729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:23.831335 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.831296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g"
Jul 25 01:11:23.833144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.833119    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:11:23.840870 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.840834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rqndk"
Jul 25 01:11:23.849113 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.849086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnx62"
Jul 25 01:11:23.859412 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.859383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:23.867728 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.867694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dqkjz"
Jul 25 01:11:23.877945 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.877918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l4zv"
Jul 25 01:11:23.887109 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:23.887080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b88r8"
Jul 25 01:11:24.126863 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:24.126762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:24.127035 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.126946    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:24.127035 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.127020    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:25.126998104 +0000 UTC m=+4.029643097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:24.227499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:24.227454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:24.227534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227647    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227650    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227679    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227700    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:24.227741 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227729    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:25.22770553 +0000 UTC m=+4.130350562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:24.228068 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:24.227751    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:25.227738508 +0000 UTC m=+4.130383514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:24.557741 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:24.557621    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 01:06:24 +0000 UTC" deadline="2028-05-02 02:00:56.78961644 +0000 UTC"
Jul 25 01:11:24.557741 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:24.557691    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15528h49m32.231935793s"
Jul 25 01:11:24.726257 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.726218    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc3e353_5005_4d91_9a8c_e93d7d959db6.slice/crio-d5234db567c849082819e16cd6f84395159728e2f5cb187152428ac6edbc3db9 WatchSource:0}: Error finding container d5234db567c849082819e16cd6f84395159728e2f5cb187152428ac6edbc3db9: Status 404 returned error can't find the container with id d5234db567c849082819e16cd6f84395159728e2f5cb187152428ac6edbc3db9
Jul 25 01:11:24.729863 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.729819    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c0f478_fb7f_47b6_8712_daab3dfbcba7.slice/crio-52ee6ddbe3a328f0263f22b797d107ab4912d706c7d2dd80df0c0367489ef43f WatchSource:0}: Error finding container 52ee6ddbe3a328f0263f22b797d107ab4912d706c7d2dd80df0c0367489ef43f: Status 404 returned error can't find the container with id 52ee6ddbe3a328f0263f22b797d107ab4912d706c7d2dd80df0c0367489ef43f
Jul 25 01:11:24.731624 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.731464    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae63b32_6345_4e08_a39f_d8064cb18883.slice/crio-4cbf2741b0bad30316ed71e3aade703537bba740e346765f596f85430874de09 WatchSource:0}: Error finding container 4cbf2741b0bad30316ed71e3aade703537bba740e346765f596f85430874de09: Status 404 returned error can't find the container with id 4cbf2741b0bad30316ed71e3aade703537bba740e346765f596f85430874de09
Jul 25 01:11:24.736556 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.736522    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6f88d7_a032_4f0e_a320_a7fac3cc187b.slice/crio-36fa3d5951542830874380113c3ce99ff3f865c757c24d3234870444c273a19b WatchSource:0}: Error finding container 36fa3d5951542830874380113c3ce99ff3f865c757c24d3234870444c273a19b: Status 404 returned error can't find the container with id 36fa3d5951542830874380113c3ce99ff3f865c757c24d3234870444c273a19b
Jul 25 01:11:24.738101 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.737630    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1190a043_2288_430b_9c28_9f203e6a1070.slice/crio-82c5f745b25894f2f11c8b352b984a9ae454a1d931cbbc99f6530f32c84ed017 WatchSource:0}: Error finding container 82c5f745b25894f2f11c8b352b984a9ae454a1d931cbbc99f6530f32c84ed017: Status 404 returned error can't find the container with id 82c5f745b25894f2f11c8b352b984a9ae454a1d931cbbc99f6530f32c84ed017
Jul 25 01:11:24.738906 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.738867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f3f8c6_fd93_4d5f_961a_f840ed529a6d.slice/crio-0dec8fce4a398d059acb01950a39c15c77b16190e3bab2bcc9cc59b9726fd507 WatchSource:0}: Error finding container 0dec8fce4a398d059acb01950a39c15c77b16190e3bab2bcc9cc59b9726fd507: Status 404 returned error can't find the container with id 0dec8fce4a398d059acb01950a39c15c77b16190e3bab2bcc9cc59b9726fd507
Jul 25 01:11:24.761826 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.761785    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076f2124_dedc_4afa_8803_4d58cc41740f.slice/crio-8f222ebf973fb5e0d8061b7f4029db328fc76d2d98a94d39f2f55fba25c5408e WatchSource:0}: Error finding container 8f222ebf973fb5e0d8061b7f4029db328fc76d2d98a94d39f2f55fba25c5408e: Status 404 returned error can't find the container with id 8f222ebf973fb5e0d8061b7f4029db328fc76d2d98a94d39f2f55fba25c5408e
Jul 25 01:11:24.762782 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:11:24.762756    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb6f6f8_a2ba_4b12_89c1_8f0f0cb70291.slice/crio-8ea121cd687ccddc355a118b57ec4fee4f9072ea828682869e85007890f19665 WatchSource:0}: Error finding container 8ea121cd687ccddc355a118b57ec4fee4f9072ea828682869e85007890f19665: Status 404 returned error can't find the container with id 8ea121cd687ccddc355a118b57ec4fee4f9072ea828682869e85007890f19665
Jul 25 01:11:25.135199 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.134884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:25.135199 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.135053    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:25.135199 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.135194    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:27.135176843 +0000 UTC m=+6.037821835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:25.236074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.236030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:25.236286 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.236136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:25.236286 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236253    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:25.236286 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236268    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:25.236286 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236286    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:25.236505 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236298    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:25.236505 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:27.23630479 +0000 UTC m=+6.138949790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:25.236505 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.236344    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:27.236334938 +0000 UTC m=+6.138979929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:25.558917 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.558869    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 01:06:24 +0000 UTC" deadline="2028-01-13 18:44:04.081301667 +0000 UTC"
Jul 25 01:11:25.558917 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.558915    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12905h32m38.522392094s"
Jul 25 01:11:25.639475 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.639297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:25.639706 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.639473    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:25.640267 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.640011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:25.640267 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.640123    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:25.640919 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.640800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:25.640919 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:25.640905    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:25.663168 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.663122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dqkjz" event={"ID":"dd6f88d7-a032-4f0e-a320-a7fac3cc187b","Type":"ContainerStarted","Data":"36fa3d5951542830874380113c3ce99ff3f865c757c24d3234870444c273a19b"}
Jul 25 01:11:25.704764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.704707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sc2mf" event={"ID":"9bc3e353-5005-4d91-9a8c-e93d7d959db6","Type":"ContainerStarted","Data":"d5234db567c849082819e16cd6f84395159728e2f5cb187152428ac6edbc3db9"}
Jul 25 01:11:25.712652 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.711613    2565 generic.go:356] "Generic (PLEG): container finished" podID="7bf40419e430fb8f1db521dd8dfa6303" containerID="ce2ce95683a3480a9ccbd61f5a7a1a12c0b4d03a4919141cf925fcf9567c230c" exitCode=0
Jul 25 01:11:25.712652 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.711724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal" event={"ID":"7bf40419e430fb8f1db521dd8dfa6303","Type":"ContainerDied","Data":"ce2ce95683a3480a9ccbd61f5a7a1a12c0b4d03a4919141cf925fcf9567c230c"}
Jul 25 01:11:25.732697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.732659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g" event={"ID":"076f2124-dedc-4afa-8803-4d58cc41740f","Type":"ContainerStarted","Data":"8f222ebf973fb5e0d8061b7f4029db328fc76d2d98a94d39f2f55fba25c5408e"}
Jul 25 01:11:25.752936 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.752892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnx62" event={"ID":"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291","Type":"ContainerStarted","Data":"8ea121cd687ccddc355a118b57ec4fee4f9072ea828682869e85007890f19665"}
Jul 25 01:11:25.776050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.776000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tltl" event={"ID":"30f3f8c6-fd93-4d5f-961a-f840ed529a6d","Type":"ContainerStarted","Data":"0dec8fce4a398d059acb01950a39c15c77b16190e3bab2bcc9cc59b9726fd507"}
Jul 25 01:11:25.799876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.799832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rqndk" event={"ID":"1ae63b32-6345-4e08-a39f-d8064cb18883","Type":"ContainerStarted","Data":"4cbf2741b0bad30316ed71e3aade703537bba740e346765f596f85430874de09"}
Jul 25 01:11:25.813492 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.813448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"52ee6ddbe3a328f0263f22b797d107ab4912d706c7d2dd80df0c0367489ef43f"}
Jul 25 01:11:25.831129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.831040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerStarted","Data":"3791bac6a818af8d1343fda9a69e9eb294800f3e02b4bd0a7e4907228eb52059"}
Jul 25 01:11:25.835908 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.835866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal" event={"ID":"79f46803104cb5b369c0e7545cf31f48","Type":"ContainerStarted","Data":"78d494d7b907f6f86712e012a5d984109a8c322ebdc7d449fab19ea056cf7ca5"}
Jul 25 01:11:25.840975 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:25.840899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b88r8" event={"ID":"1190a043-2288-430b-9c28-9f203e6a1070","Type":"ContainerStarted","Data":"82c5f745b25894f2f11c8b352b984a9ae454a1d931cbbc99f6530f32c84ed017"}
Jul 25 01:11:26.859821 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:26.859781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal" event={"ID":"7bf40419e430fb8f1db521dd8dfa6303","Type":"ContainerStarted","Data":"61d22d4338c0d47edf7f1eba27906a6157a8450c7f5906845f5a3fff65b86395"}
Jul 25 01:11:26.874045 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:26.873972    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-23.ec2.internal" podStartSLOduration=3.873945036 podStartE2EDuration="3.873945036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:25.851306501 +0000 UTC m=+4.753951518" watchObservedRunningTime="2026-07-25 01:11:26.873945036 +0000 UTC m=+5.776590051"
Jul 25 01:11:26.875245 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:26.875168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-23.ec2.internal" podStartSLOduration=3.875153175 podStartE2EDuration="3.875153175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:26.87494681 +0000 UTC m=+5.777591827" watchObservedRunningTime="2026-07-25 01:11:26.875153175 +0000 UTC m=+5.777798192"
Jul 25 01:11:27.154470 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.154308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:27.154701 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.154481    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:27.154701 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.154577    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:31.154534114 +0000 UTC m=+10.057179108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:27.255950 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.255903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:27.256144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.256022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:27.256296 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256276    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:27.256371 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256303    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:27.256371 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256319    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:27.256480 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256385    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:31.256363825 +0000 UTC m=+10.159008819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:27.256938 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256917    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:27.257031 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.256989    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:31.256970997 +0000 UTC m=+10.159616016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.648154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.648349    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.648819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.648937    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:27.649000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:27.649190 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:27.649079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:29.639721 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:29.639681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:29.640289 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:29.639837    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:29.640361 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:29.640345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:29.640585 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:29.640472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:29.640585 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:29.640563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:29.640734 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:29.640686    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:31.199344 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.199294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:31.199927 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.199494    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:31.199927 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.199612    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:39.199584951 +0000 UTC m=+18.102229947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:31.300749 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.300705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:31.300939 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.300817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:31.300939 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.300884    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:31.301067 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.300965    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:31.301067 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.300976    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:39.300951649 +0000 UTC m=+18.203596655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:31.301067 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.300988    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:31.301067 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.301003    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:31.301067 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.301063    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:39.301046487 +0000 UTC m=+18.203691482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:31.640984 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.640766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:31.640984 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.640881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:31.640984 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:31.640912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:31.641246 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.641008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:31.641487 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.641414    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:31.641487 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:31.641442    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:33.640630 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:33.639584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:33.640630 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:33.639726    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:33.640630 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:33.639803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:33.640630 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:33.639872    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:33.640630 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:33.640568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:33.641277 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:33.640662    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:35.639798 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:35.639755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:35.640288 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:35.639754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:35.640288 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:35.639905    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:35.640288 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:35.640026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:35.640288 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:35.639761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:35.640288 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:35.640113    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:37.639118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:37.639073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:37.639611 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:37.639076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:37.639611 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:37.639214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:37.639611 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:37.639073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:37.639611 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:37.639277    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:37.639611 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:37.639414    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:39.270843 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.270796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:39.271326 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.270959    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:39.271326 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.271041    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:55.271019076 +0000 UTC m=+34.173664068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:39.372130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.372089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:39.372322 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.372154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:39.372322 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372274    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:39.372426 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372336    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:55.372321698 +0000 UTC m=+34.274966687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:39.372426 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372277    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:39.372426 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372368    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:39.372426 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372380    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:39.372426 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.372417    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:55.372406941 +0000 UTC m=+34.275051931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:39.639273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.639238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:39.639273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.639265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:39.639491 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:39.639237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:39.639491 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.639377    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:39.639491 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.639439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:39.639491 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:39.639486    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:41.640228 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:41.640186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:41.640734 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:41.640306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:41.640734 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:41.640315    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:41.640734 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:41.640471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:41.640734 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:41.640483    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:41.640734 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:41.640577    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.642176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:43.642314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.642722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:43.642821    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.642869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:43.643220 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:43.642940    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:43.900230 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.899708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b88r8" event={"ID":"1190a043-2288-430b-9c28-9f203e6a1070","Type":"ContainerStarted","Data":"778c6bc0ea9dbdae92eb4141797aabb31ac96d333942ea8e1ef2d1281a6566c1"}
Jul 25 01:11:43.902009 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.901972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dqkjz" event={"ID":"dd6f88d7-a032-4f0e-a320-a7fac3cc187b","Type":"ContainerStarted","Data":"03685437574d805f0f40e8d410d7d27bc0140b2ee8322b01f217dc203cd2ffe5"}
Jul 25 01:11:43.904198 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.904172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g" event={"ID":"076f2124-dedc-4afa-8803-4d58cc41740f","Type":"ContainerStarted","Data":"be39bb7d3c285aef6c9f7325afc03c6989c15d8853ee4cff90137ebec6f962b4"}
Jul 25 01:11:43.906153 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.906133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnx62" event={"ID":"5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291","Type":"ContainerStarted","Data":"9e405d41c28026ee091e806d8404ec6fbafc7bcda3e62f96c2babc53da4e2c31"}
Jul 25 01:11:43.907937 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.907913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tltl" event={"ID":"30f3f8c6-fd93-4d5f-961a-f840ed529a6d","Type":"ContainerStarted","Data":"f2a1d918ad5c139a8b948b6127e510ef33b53fa1d44a3e7ea30c3757fba8caaa"}
Jul 25 01:11:43.909868 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.909841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rqndk" event={"ID":"1ae63b32-6345-4e08-a39f-d8064cb18883","Type":"ContainerStarted","Data":"b117a79e167c86d0a7a0f54545c2e487c711585bf6dcc8a0d5da1b4e25094a7e"}
Jul 25 01:11:43.911443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.911420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"d22ffc0097ebc5903479c32dab2e5e1d9dbdba0fcd4e394a32f7d4170a166cb0"}
Jul 25 01:11:43.911552 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.911479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"491e324987478c911f870a977309013c0866c9c450210823a0b461876e4ee2c5"}
Jul 25 01:11:43.913043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.913007    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="9b89e4a946d42847a1d4cebcd870db4f47cae5d7556e45321ead510b20e23171" exitCode=0
Jul 25 01:11:43.913162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.913051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"9b89e4a946d42847a1d4cebcd870db4f47cae5d7556e45321ead510b20e23171"}
Jul 25 01:11:43.916417 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.916351    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b88r8" podStartSLOduration=3.0175193829999998 podStartE2EDuration="21.916333514s" totalImagesPullingTime="18.898814131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:43.916021046 +0000 UTC m=+22.818666059" watchObservedRunningTime="2026-07-25 01:11:43.916333514 +0000 UTC m=+22.818978526"
Jul 25 01:11:43.945226 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.945175    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dqkjz" podStartSLOduration=3.09813251 podStartE2EDuration="21.945158741s" totalImagesPullingTime="18.847026231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:43.930807415 +0000 UTC m=+22.833452426" watchObservedRunningTime="2026-07-25 01:11:43.945158741 +0000 UTC m=+22.847803806"
Jul 25 01:11:43.963697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.963639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rqndk" podStartSLOduration=3.089616389 podStartE2EDuration="21.963618331s" totalImagesPullingTime="18.874001942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:43.945013646 +0000 UTC m=+22.847658657" watchObservedRunningTime="2026-07-25 01:11:43.963618331 +0000 UTC m=+22.866263343"
Jul 25 01:11:43.975690 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:43.975640    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4tltl" podStartSLOduration=10.866323797 podStartE2EDuration="21.975621057s" totalImagesPullingTime="11.10929726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:43.975045725 +0000 UTC m=+22.877690810" watchObservedRunningTime="2026-07-25 01:11:43.975621057 +0000 UTC m=+22.878266067"
Jul 25 01:11:44.323137 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.323080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:44.402274 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.402174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:44.587030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.586981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:44.688292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.688207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:44.789563 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.789527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:44.919502 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.919443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"28fdfb6065c3d78f00b1e688dbd2d48f4720b63d08f73f6324dd493e43db452a"}
Jul 25 01:11:44.919786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.919609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"b2c961d5939d31a7221d53f718b6ea76b3904368580c3d2895dd5b7d1ca62fe0"}
Jul 25 01:11:44.919786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.919666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"b19fe2c594fd99cdc076783df2b0b0976c4822eea5bb65c0006e0fcafd51df5d"}
Jul 25 01:11:44.919786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.919728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"bbefc383918454d4a210a50ee554e2580b3352a2f8bc82373079935dfcb636cd"}
Jul 25 01:11:44.990907 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:44.990752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:45.190079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.190045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:45.240529 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.240470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:45.273022 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.272995    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 25 01:11:45.575813 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.575651    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-25T01:11:45.273015113Z","UUID":"e0191349-d014-4059-9778-c0e83ab9b5c6","Handler":null,"Name":"","Endpoint":""}
Jul 25 01:11:45.577687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.577634    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 25 01:11:45.577687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.577693    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 25 01:11:45.639715 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.639577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:45.639929 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:45.639729    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:45.639929 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.639921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:45.640361 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:45.640051    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:45.640361 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.640094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:45.640361 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:45.640182    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:45.924653 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.924598    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sc2mf" event={"ID":"9bc3e353-5005-4d91-9a8c-e93d7d959db6","Type":"ContainerStarted","Data":"3bc170ec3b2896b1b9d3b0b1eb29f92cd5a4455496db99b377cd8324eec26a4e"}
Jul 25 01:11:45.926804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.926764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g" event={"ID":"076f2124-dedc-4afa-8803-4d58cc41740f","Type":"ContainerStarted","Data":"49ca17a543eeab448a57c3556c2b075aff5167ef2c1b5de7629b2b767cb4e3fa"}
Jul 25 01:11:45.937427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.937373    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sc2mf" podStartSLOduration=5.058754206 podStartE2EDuration="23.937356295s" totalImagesPullingTime="18.878602089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:45.93680874 +0000 UTC m=+24.839453751" watchObservedRunningTime="2026-07-25 01:11:45.937356295 +0000 UTC m=+24.840001307"
Jul 25 01:11:45.937650 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:45.937496    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bnx62" podStartSLOduration=5.094786411 podStartE2EDuration="23.93748673s" totalImagesPullingTime="18.842700319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:43.988701092 +0000 UTC m=+22.891346102" watchObservedRunningTime="2026-07-25 01:11:45.93748673 +0000 UTC m=+24.840131742"
Jul 25 01:11:46.393056 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:46.393006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:46.604405 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:46.604315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:46.792337 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:46.792303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:46.991323 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:46.991243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:47.078046 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.078009    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:47.078718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.078701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:47.190706 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.190669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:47.244186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.244101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:47.639716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.639682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:47.639991 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.639741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:47.639991 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.639682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:47.639991 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:47.639823    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:47.639991 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:47.639929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:47.640186 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:47.640020    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:47.943583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.943274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:47.943852 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:47.943834    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4tltl"
Jul 25 01:11:48.395523 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.395477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:48.534148 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.534052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:48.588388 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.588354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:48.793212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.793131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:48.936855 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.936819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"b1651a7298fbdf995d70b4c7dbc749383a6bf901b78bdb18f33cb38a1fbd4d99"}
Jul 25 01:11:48.938634 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.938608    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="19dc83e01420da9c4819a140f74912e631fd92b3741ca82637980e69fbecf879" exitCode=0
Jul 25 01:11:48.938787 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.938699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"19dc83e01420da9c4819a140f74912e631fd92b3741ca82637980e69fbecf879"}
Jul 25 01:11:48.940981 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.940924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g" event={"ID":"076f2124-dedc-4afa-8803-4d58cc41740f","Type":"ContainerStarted","Data":"f2a3d8229d2b78c1d13ff3f79045a8d473b293d07b783244b639cfe742df32c3"}
Jul 25 01:11:48.973495 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.973435    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktt9g" podStartSLOduration=4.193208257 podStartE2EDuration="26.973416309s" totalImagesPullingTime="22.780208052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:48.973121841 +0000 UTC m=+27.875766853" watchObservedRunningTime="2026-07-25 01:11:48.973416309 +0000 UTC m=+27.876061321"
Jul 25 01:11:48.991006 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:48.990970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:49.192098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.192057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:49.639458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.639420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:49.640170 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:49.639991    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:49.642693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.640457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:49.642693 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:49.640805    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:49.642693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.640840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:49.642693 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:49.640972    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:49.945483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.945395    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="d8e3d8f42705dad2ca275f3cf6a7d1be729b6a74708ece4b25b34d8b0d4cfbf4" exitCode=0
Jul 25 01:11:49.945653 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.945482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"d8e3d8f42705dad2ca275f3cf6a7d1be729b6a74708ece4b25b34d8b0d4cfbf4"}
Jul 25 01:11:49.992019 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:49.991979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:50.595619 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.595209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:50.783187 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.783152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:50.951331 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.951297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" event={"ID":"01c0f478-fb7f-47b6-8712-daab3dfbcba7","Type":"ContainerStarted","Data":"26028acc77aa895aedac1f8a71c9c0dc5fe22f60c3c68a84cca81d0290bf50b5"}
Jul 25 01:11:50.951546 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.951518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:50.951657 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.951588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:50.951657 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.951633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:50.954224 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.954195    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="3cd1d8bf019e2dc791cdbe865e17f34c6abf23840b3f08c354c6f6156324063c" exitCode=0
Jul 25 01:11:50.954359 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.954255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"3cd1d8bf019e2dc791cdbe865e17f34c6abf23840b3f08c354c6f6156324063c"}
Jul 25 01:11:50.968164 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.968139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:50.968288 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.968247    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:11:50.973815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.973767    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb" podStartSLOduration=10.034946734 podStartE2EDuration="28.973750312s" totalImagesPullingTime="18.938803578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:50.973379281 +0000 UTC m=+29.876024302" watchObservedRunningTime="2026-07-25 01:11:50.973750312 +0000 UTC m=+29.876395323"
Jul 25 01:11:50.990240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:50.990206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:51.184913 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:51.184787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:51.641166 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:51.641131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:51.641397 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:51.641244    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:51.641397 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:51.641304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:51.641397 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:51.641371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:51.641563 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:51.641476    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:51.641614 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:51.641568    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:53.639839 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:53.639763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:53.639839 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:53.639778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:53.640352 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:53.639871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:53.640352 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:53.639886    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:53.640352 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:53.639999    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:53.640352 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:53.640093    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:55.300762 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.300716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:55.301230 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.300900    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:55.301230 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.301008    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs podName:9f47eaa5-0859-40b6-a4df-3b2c764a6577 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.300983833 +0000 UTC m=+66.203628826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs") pod "network-metrics-daemon-s4tph" (UID: "9f47eaa5-0859-40b6-a4df-3b2c764a6577") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 01:11:55.402095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.402041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:55.402296 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.402122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:55.402296 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402251    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:55.402425 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402323    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret podName:84d442b8-e39e-4173-a424-36af1e358299 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.402303219 +0000 UTC m=+66.304948228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret") pod "global-pull-secret-syncer-lgctr" (UID: "84d442b8-e39e-4173-a424-36af1e358299") : object "kube-system"/"original-pull-secret" not registered
Jul 25 01:11:55.402425 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402250    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 01:11:55.402425 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402363    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 01:11:55.402425 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402380    2565 projected.go:196] Error preparing data for projected volume kube-api-access-r2dnf for pod openshift-network-diagnostics/network-check-target-8qwmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:55.402618 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.402441    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf podName:5857c619-3642-4479-8c6b-4d287583eb43 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.402425038 +0000 UTC m=+66.305070040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2dnf" (UniqueName: "kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf") pod "network-check-target-8qwmp" (UID: "5857c619-3642-4479-8c6b-4d287583eb43") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 01:11:55.639696 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.639655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:55.639877 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.639656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:55.639877 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.639773    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:55.639955 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:55.639656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:55.639987 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.639877    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:55.640017 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:55.639976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:56.972383 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:56.972348    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="1d4a396a70160f851707f78becc38c7dcc100b24e91f4acfbd919bfe36c283c8" exitCode=0
Jul 25 01:11:56.972907 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:56.972396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"1d4a396a70160f851707f78becc38c7dcc100b24e91f4acfbd919bfe36c283c8"}
Jul 25 01:11:57.389877 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.389832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:57.463996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.463952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:57.567350 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.567310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:57.639449 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.639419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:57.639653 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.639539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:57.639653 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.639571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:57.639746 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:57.639648    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:57.639746 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:57.639543    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:57.639804 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:57.639745    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:57.745159 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.745074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:57.804641 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.804599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:57.978420 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.978218    2565 generic.go:356] "Generic (PLEG): container finished" podID="131387d4-83e4-45bf-8339-91815f154788" containerID="631e3f5ad340a441f7454d580e7f3f70f0d7733f4b792d84fcf241c1d4d77f5a" exitCode=0
Jul 25 01:11:57.978868 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:57.978298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerDied","Data":"631e3f5ad340a441f7454d580e7f3f70f0d7733f4b792d84fcf241c1d4d77f5a"}
Jul 25 01:11:58.467841 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.467801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s4tph"]
Jul 25 01:11:58.468028 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.467971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:11:58.468128 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:58.468100    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:11:58.471285 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.471257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qwmp"]
Jul 25 01:11:58.471582 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.471560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:11:58.471715 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:58.471689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:11:58.472370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.472018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgctr"]
Jul 25 01:11:58.472370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.472123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:58.472370 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:58.472214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:58.984132 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:58.984090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" event={"ID":"131387d4-83e4-45bf-8339-91815f154788","Type":"ContainerStarted","Data":"7152e356a7ba8f3deb147d144d497d53aa1ceed4e7f77a2dd4f4453bee3b3fa7"}
Jul 25 01:11:59.004670 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.004618    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5l4zv" podStartSLOduration=7.291672349 podStartE2EDuration="37.004599451s" totalImagesPullingTime="29.712927102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:59.003941406 +0000 UTC m=+37.906586416" watchObservedRunningTime="2026-07-25 01:11:59.004599451 +0000 UTC m=+37.907244462"
Jul 25 01:11:59.125643 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.125535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:59.224403 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.224364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:59.639864 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.639831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:11:59.640099 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:11:59.639967    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:11:59.659077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.659039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:59.759601 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.759570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:11:59.940355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:11:59.940225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:00.040875 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.040837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:00.132470 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.132441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:00.639591 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.639552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:12:00.639763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.639551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:00.639763 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:00.639669    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s4tph" podUID="9f47eaa5-0859-40b6-a4df-3b2c764a6577"
Jul 25 01:12:00.639763 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:00.639744    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qwmp" podUID="5857c619-3642-4479-8c6b-4d287583eb43"
Jul 25 01:12:00.862139 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.862083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:00.962459 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:00.962411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:01.639823 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:01.639786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:12:01.640315 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:01.639880    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgctr" podUID="84d442b8-e39e-4173-a424-36af1e358299"
Jul 25 01:12:02.439712 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.439631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:02.467089 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.467062    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-23.ec2.internal" event="NodeReady"
Jul 25 01:12:02.467215 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.467193    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 25 01:12:02.514931 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.514899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8xpqk"]
Jul 25 01:12:02.516818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.516800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.518401 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.518373    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sghr6"]
Jul 25 01:12:02.518916 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.518895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 25 01:12:02.519028 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.518926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 25 01:12:02.519447 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.519421    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4svzl\""
Jul 25 01:12:02.521710 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.521685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.523779 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.523756    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 25 01:12:02.523896 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.523839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-srmhs\""
Jul 25 01:12:02.523896 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.523863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:02.524004 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.523759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 25 01:12:02.524004 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.523934    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 25 01:12:02.530883 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.530861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8xpqk"]
Jul 25 01:12:02.545735 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.545700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sghr6"]
Jul 25 01:12:02.559011 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.558982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c7dab3-7e83-42dc-8f72-907cb44e2704-tmp-dir\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.559318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.559035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-cert\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.559318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.559059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvvk\" (UniqueName: \"kubernetes.io/projected/a3c7dab3-7e83-42dc-8f72-907cb44e2704-kube-api-access-kxvvk\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.559318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.559087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx44t\" (UniqueName: \"kubernetes.io/projected/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-kube-api-access-wx44t\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.559318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.559116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3c7dab3-7e83-42dc-8f72-907cb44e2704-metrics-tls\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.559318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.559169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3c7dab3-7e83-42dc-8f72-907cb44e2704-config-volume\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.625996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.625959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:02.638249 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.638210    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"]
Jul 25 01:12:02.640051 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.640036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:02.640384 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.640127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:02.640384 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.640253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:12:02.641958 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.641932    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 25 01:12:02.641958 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.641947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4ttp\""
Jul 25 01:12:02.642172 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.642107    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 25 01:12:02.642422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.642229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 25 01:12:02.642422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.642299    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 25 01:12:02.642422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.642337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djkst\""
Jul 25 01:12:02.642695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.642437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t2qkf\""
Jul 25 01:12:02.651974 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.651947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"]
Jul 25 01:12:02.659461 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-cert\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.659693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvvk\" (UniqueName: \"kubernetes.io/projected/a3c7dab3-7e83-42dc-8f72-907cb44e2704-kube-api-access-kxvvk\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.659693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx44t\" (UniqueName: \"kubernetes.io/projected/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-kube-api-access-wx44t\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.659923 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3c7dab3-7e83-42dc-8f72-907cb44e2704-metrics-tls\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.659923 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3c7dab3-7e83-42dc-8f72-907cb44e2704-config-volume\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.659923 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c7dab3-7e83-42dc-8f72-907cb44e2704-tmp-dir\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.659923 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.659847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tr6vq\" (UID: \"281ef643-efe8-4437-8e50-94c11e8e9d61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:02.660419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.660395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c7dab3-7e83-42dc-8f72-907cb44e2704-tmp-dir\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.660702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.660684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3c7dab3-7e83-42dc-8f72-907cb44e2704-config-volume\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.665577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.665550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3c7dab3-7e83-42dc-8f72-907cb44e2704-metrics-tls\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.665709 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.665583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-cert\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.670765 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.670724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvvk\" (UniqueName: \"kubernetes.io/projected/a3c7dab3-7e83-42dc-8f72-907cb44e2704-kube-api-access-kxvvk\") pod \"dns-default-8xpqk\" (UID: \"a3c7dab3-7e83-42dc-8f72-907cb44e2704\") " pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.671331 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.671309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx44t\" (UniqueName: \"kubernetes.io/projected/bbe5ad57-a208-461c-87f6-f8df4c0a2d20-kube-api-access-wx44t\") pod \"ingress-canary-sghr6\" (UID: \"bbe5ad57-a208-461c-87f6-f8df4c0a2d20\") " pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.710137 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.710036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:02.760327 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.760289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tr6vq\" (UID: \"281ef643-efe8-4437-8e50-94c11e8e9d61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:02.760532 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:02.760428    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 25 01:12:02.760532 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:02.760502    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates podName:281ef643-efe8-4437-8e50-94c11e8e9d61 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.260483894 +0000 UTC m=+42.163128886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-tr6vq" (UID: "281ef643-efe8-4437-8e50-94c11e8e9d61") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 25 01:12:02.830738 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.830702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:02.835374 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.835355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sghr6"
Jul 25 01:12:02.908494 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.908458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z9npk"]
Jul 25 01:12:02.917197 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.917158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.919268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.919222    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 25 01:12:02.919477 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.919223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 25 01:12:02.919743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.919668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 25 01:12:02.920272 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.920198    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z9n5z\""
Jul 25 01:12:02.921246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.921168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 25 01:12:02.921246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.921199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9npk"]
Jul 25 01:12:02.946199 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.946024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:02.961090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.960988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.961090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.961044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11889849-9aca-4581-9ff2-c3e7174ff9a1-crio-socket\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.961090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.961082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.961329 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.961103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw49d\" (UniqueName: \"kubernetes.io/projected/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-api-access-xw49d\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.961329 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.961193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11889849-9aca-4581-9ff2-c3e7174ff9a1-data-volume\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:02.981795 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.981765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8xpqk"]
Jul 25 01:12:02.985364 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:02.985338    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c7dab3_7e83_42dc_8f72_907cb44e2704.slice/crio-11c6d765f9a763a5b8431b1c0ed06e5d9b400a850c101b32ee3b224378e5b386 WatchSource:0}: Error finding container 11c6d765f9a763a5b8431b1c0ed06e5d9b400a850c101b32ee3b224378e5b386: Status 404 returned error can't find the container with id 11c6d765f9a763a5b8431b1c0ed06e5d9b400a850c101b32ee3b224378e5b386
Jul 25 01:12:02.991798 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.991424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sghr6"]
Jul 25 01:12:02.996076 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:02.995420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xpqk" event={"ID":"a3c7dab3-7e83-42dc-8f72-907cb44e2704","Type":"ContainerStarted","Data":"11c6d765f9a763a5b8431b1c0ed06e5d9b400a850c101b32ee3b224378e5b386"}
Jul 25 01:12:02.997986 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:02.997961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe5ad57_a208_461c_87f6_f8df4c0a2d20.slice/crio-ac693d06aa7355467cb984fe10599a3975b3457b9c11fc5948cb0884bbbe1909 WatchSource:0}: Error finding container ac693d06aa7355467cb984fe10599a3975b3457b9c11fc5948cb0884bbbe1909: Status 404 returned error can't find the container with id ac693d06aa7355467cb984fe10599a3975b3457b9c11fc5948cb0884bbbe1909
Jul 25 01:12:03.001790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.001763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:03.062092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11889849-9aca-4581-9ff2-c3e7174ff9a1-data-volume\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062355 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.062169    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 01:12:03.062355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11889849-9aca-4581-9ff2-c3e7174ff9a1-crio-socket\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062355 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.062237    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.562222426 +0000 UTC m=+42.464867415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : configmap "kube-rbac-proxy" not found
Jul 25 01:12:03.062355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw49d\" (UniqueName: \"kubernetes.io/projected/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-api-access-xw49d\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062617 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11889849-9aca-4581-9ff2-c3e7174ff9a1-crio-socket\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.062617 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.062394    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:03.062617 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.062448    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.56243048 +0000 UTC m=+42.465075490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:03.062617 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.062453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11889849-9aca-4581-9ff2-c3e7174ff9a1-data-volume\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.069559 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.069536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw49d\" (UniqueName: \"kubernetes.io/projected/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-api-access-xw49d\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.213985 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.213897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:03.266475 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.266433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tr6vq\" (UID: \"281ef643-efe8-4437-8e50-94c11e8e9d61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:03.268991 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.268955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/281ef643-efe8-4437-8e50-94c11e8e9d61-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tr6vq\" (UID: \"281ef643-efe8-4437-8e50-94c11e8e9d61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:03.557398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.557074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:03.568946 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.568883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.569145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.568975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:03.569145 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.569075    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 01:12:03.569265 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.569146    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:03.569265 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.569198    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:04.569181307 +0000 UTC m=+43.471826297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : configmap "kube-rbac-proxy" not found
Jul 25 01:12:03.569265 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:03.569220    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:04.569209823 +0000 UTC m=+43.471854814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:03.615040 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.614999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:03.644899 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.644261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:12:03.646659 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.646416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 25 01:12:03.714335 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.714285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:03.753197 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:03.753158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"]
Jul 25 01:12:03.758486 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:03.758451    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281ef643_efe8_4437_8e50_94c11e8e9d61.slice/crio-8c5b80ef002a14132f72f18d04f764a7fe4b7e1a871a45d27e2b9412016da8ee WatchSource:0}: Error finding container 8c5b80ef002a14132f72f18d04f764a7fe4b7e1a871a45d27e2b9412016da8ee: Status 404 returned error can't find the container with id 8c5b80ef002a14132f72f18d04f764a7fe4b7e1a871a45d27e2b9412016da8ee
Jul 25 01:12:04.000475 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:04.000427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq" event={"ID":"281ef643-efe8-4437-8e50-94c11e8e9d61","Type":"ContainerStarted","Data":"8c5b80ef002a14132f72f18d04f764a7fe4b7e1a871a45d27e2b9412016da8ee"}
Jul 25 01:12:04.002003 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:04.001964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sghr6" event={"ID":"bbe5ad57-a208-461c-87f6-f8df4c0a2d20","Type":"ContainerStarted","Data":"ac693d06aa7355467cb984fe10599a3975b3457b9c11fc5948cb0884bbbe1909"}
Jul 25 01:12:04.577957 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:04.577911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:04.578186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:04.577998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:04.578186 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:04.578063    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 01:12:04.578186 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:04.578165    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:06.578140392 +0000 UTC m=+45.480785386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : configmap "kube-rbac-proxy" not found
Jul 25 01:12:04.578368 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:04.578205    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:04.578368 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:04.578268    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:06.578251094 +0000 UTC m=+45.480896086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:04.911003 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:04.910977    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnx62_5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291/dns-node-resolver/0.log"
Jul 25 01:12:05.910046 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:05.910020    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dqkjz_dd6f88d7-a032-4f0e-a320-a7fac3cc187b/node-ca/0.log"
Jul 25 01:12:05.935221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:05.935167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:06.035906 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:06.035850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:06.588746 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:06.588709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:06.588895 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:06.588787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:06.589102 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:06.589011    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:06.589102 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:06.589033    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 01:12:06.589102 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:06.589089    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:10.589068107 +0000 UTC m=+49.491713098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : secret "insights-runtime-extractor-tls" not found
Jul 25 01:12:06.589341 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:06.589111    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm podName:11889849-9aca-4581-9ff2-c3e7174ff9a1 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:10.589100416 +0000 UTC m=+49.491745412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9npk" (UID: "11889849-9aca-4581-9ff2-c3e7174ff9a1") : configmap "kube-rbac-proxy" not found
Jul 25 01:12:06.982273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:06.982238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.012020 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.011985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xpqk" event={"ID":"a3c7dab3-7e83-42dc-8f72-907cb44e2704","Type":"ContainerStarted","Data":"2dbf5b498dcfc937f4d5db3e8c7a577a67b8213ce0c0e0864ca701f40c0952a8"}
Jul 25 01:12:07.012191 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.012049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xpqk" event={"ID":"a3c7dab3-7e83-42dc-8f72-907cb44e2704","Type":"ContainerStarted","Data":"e2949ef11a6610faaabccf27f5ea2a8257db239e30ee905a70b5d4bbe3b98187"}
Jul 25 01:12:07.012191 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.012075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:07.016702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.016664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq" event={"ID":"281ef643-efe8-4437-8e50-94c11e8e9d61","Type":"ContainerStarted","Data":"0f0b8f73ee02e9924cf6d770b38c1fcd99f6b9c4222135da38209cd84b92abbe"}
Jul 25 01:12:07.016875 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.016773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:07.018277 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.018253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sghr6" event={"ID":"bbe5ad57-a208-461c-87f6-f8df4c0a2d20","Type":"ContainerStarted","Data":"ece1b3e62f17db2aecaeb0c3c26d9f5cf53948fd9a6784030c424bc3de8acfac"}
Jul 25 01:12:07.021663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.021640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq"
Jul 25 01:12:07.030033 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.029941    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8xpqk" podStartSLOduration=1.503590094 podStartE2EDuration="5.029928097s" totalImagesPullingTime="3.526338003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:07.029121581 +0000 UTC m=+45.931766592" watchObservedRunningTime="2026-07-25 01:12:07.029928097 +0000 UTC m=+45.932573108"
Jul 25 01:12:07.043637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.043345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tr6vq" podStartSLOduration=2.259308853 podStartE2EDuration="5.043326267s" totalImagesPullingTime="2.784017414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:07.043265153 +0000 UTC m=+45.945910160" watchObservedRunningTime="2026-07-25 01:12:07.043326267 +0000 UTC m=+45.945971278"
Jul 25 01:12:07.047621 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.047583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.057333 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.057282    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sghr6" podStartSLOduration=1.513970781 podStartE2EDuration="5.05726422s" totalImagesPullingTime="3.543293439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:07.056336157 +0000 UTC m=+45.958981161" watchObservedRunningTime="2026-07-25 01:12:07.05726422 +0000 UTC m=+45.959909265"
Jul 25 01:12:07.101648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.101614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.656122 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.656079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.689452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.689415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"]
Jul 25 01:12:07.711815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.711782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"]
Jul 25 01:12:07.711976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.711901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.713843 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.713814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 25 01:12:07.713970 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.713814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 25 01:12:07.714299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.714274    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 25 01:12:07.714423 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.714324    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 25 01:12:07.714423 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.714363    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7tjsl\""
Jul 25 01:12:07.714548 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.714428    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 25 01:12:07.732487 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.732447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.796865 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.796822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrblw\" (UniqueName: \"kubernetes.io/projected/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-kube-api-access-qrblw\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.797041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.796912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.797041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.796965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.797041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.796997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.859966 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.859934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:07.898120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.898073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrblw\" (UniqueName: \"kubernetes.io/projected/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-kube-api-access-qrblw\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.898340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.898157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.898340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.898194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.898340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.898219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.898975 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.898956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.900696 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.900675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.900779 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.900745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.905148 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.905125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrblw\" (UniqueName: \"kubernetes.io/projected/0f4193df-9ac4-4ac4-abe8-691c6a59aa11-kube-api-access-qrblw\") pod \"prometheus-operator-84d69f794d-l2rzw\" (UID: \"0f4193df-9ac4-4ac4-abe8-691c6a59aa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:07.957352 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:07.957266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:08.020858 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:08.020818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"
Jul 25 01:12:08.170096 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:08.170050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2rzw"]
Jul 25 01:12:08.173772 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:08.173744    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4193df_9ac4_4ac4_abe8_691c6a59aa11.slice/crio-4d50fe38f31882b1bf3fc72806c328a3493922b5f7158292fd862e3433c49363 WatchSource:0}: Error finding container 4d50fe38f31882b1bf3fc72806c328a3493922b5f7158292fd862e3433c49363: Status 404 returned error can't find the container with id 4d50fe38f31882b1bf3fc72806c328a3493922b5f7158292fd862e3433c49363
Jul 25 01:12:09.025434 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:09.025379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw" event={"ID":"0f4193df-9ac4-4ac4-abe8-691c6a59aa11","Type":"ContainerStarted","Data":"4d50fe38f31882b1bf3fc72806c328a3493922b5f7158292fd862e3433c49363"}
Jul 25 01:12:10.030597 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.030567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw" event={"ID":"0f4193df-9ac4-4ac4-abe8-691c6a59aa11","Type":"ContainerStarted","Data":"caa5ec50ad325a232a9f33ef4e2cf7a21d21f99f8eeefbc965ec39d5c0a2ac11"}
Jul 25 01:12:10.152443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.152352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:10.489706 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.489611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:10.619373 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.619343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:10.619609 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.619390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:10.620054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.620024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11889849-9aca-4581-9ff2-c3e7174ff9a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:10.620572 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.620548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:10.621998 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.621975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11889849-9aca-4581-9ff2-c3e7174ff9a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9npk\" (UID: \"11889849-9aca-4581-9ff2-c3e7174ff9a1\") " pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:10.731526 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.731477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9npk"
Jul 25 01:12:10.878686 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:10.878649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9npk"]
Jul 25 01:12:10.882148 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:10.882119    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11889849_9aca_4581_9ff2_c3e7174ff9a1.slice/crio-ddcf3fd45b7aaefc84f48cac80a5b388458537faf6903abe084dd9ba7288c720 WatchSource:0}: Error finding container ddcf3fd45b7aaefc84f48cac80a5b388458537faf6903abe084dd9ba7288c720: Status 404 returned error can't find the container with id ddcf3fd45b7aaefc84f48cac80a5b388458537faf6903abe084dd9ba7288c720
Jul 25 01:12:11.036322 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:11.036220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw" event={"ID":"0f4193df-9ac4-4ac4-abe8-691c6a59aa11","Type":"ContainerStarted","Data":"5f1582cc062d990e86d8fcb581db5b5a2b8aac97274b5ceefb79b6647ab44b90"}
Jul 25 01:12:11.037440 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:11.037410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9npk" event={"ID":"11889849-9aca-4581-9ff2-c3e7174ff9a1","Type":"ContainerStarted","Data":"ddcf3fd45b7aaefc84f48cac80a5b388458537faf6903abe084dd9ba7288c720"}
Jul 25 01:12:11.053824 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:11.053769    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2rzw" podStartSLOduration=2.393678877 podStartE2EDuration="4.053748009s" totalImagesPullingTime="1.660069132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:11.052667307 +0000 UTC m=+49.955312338" watchObservedRunningTime="2026-07-25 01:12:11.053748009 +0000 UTC m=+49.956393020"
Jul 25 01:12:11.801059 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:11.801017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:11.894083 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:11.894046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:12.823705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:12.823662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.007979 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.007938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.073873 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.073775    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"]
Jul 25 01:12:13.091173 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.091141    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"]
Jul 25 01:12:13.091334 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.091296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.093596 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.093570    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wd8hj\""
Jul 25 01:12:13.093927 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.093898    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 25 01:12:13.094192 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.094002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 25 01:12:13.105233 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.105201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"]
Jul 25 01:12:13.105387 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.105355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.107295 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.107276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 25 01:12:13.107448 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.107433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8l87m\""
Jul 25 01:12:13.107613 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.107597    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 25 01:12:13.113374 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.113353    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 25 01:12:13.122206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.122175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"]
Jul 25 01:12:13.122864 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.122848    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8vwx2"]
Jul 25 01:12:13.134697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.134650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.140293 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/505debb5-370d-42dc-aeda-2a2ad0ba4a74-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.140538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82fc6be-efaf-459f-9014-00745b51e6a6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.140538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.140538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.140538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ktnv\" (UniqueName: \"kubernetes.io/projected/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-api-access-4ktnv\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.140933 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.140933 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.140933 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.140933 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.141129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k545\" (UniqueName: \"kubernetes.io/projected/d82fc6be-efaf-459f-9014-00745b51e6a6-kube-api-access-7k545\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.141129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.140985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.142306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.142282    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tqbdc\""
Jul 25 01:12:13.142463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.142448    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 25 01:12:13.142463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.142456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 25 01:12:13.142672 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.142650    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 25 01:12:13.237154 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.237117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.242029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.241989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82fc6be-efaf-459f-9014-00745b51e6a6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.242212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-wtmp\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-sys\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-root\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242434 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.242434 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.242694 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:13.242564    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 25 01:12:13.242694 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-textfile\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242694 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:13.242626    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls podName:505debb5-370d-42dc-aeda-2a2ad0ba4a74 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:13.742607527 +0000 UTC m=+52.645252530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-5fd92" (UID: "505debb5-370d-42dc-aeda-2a2ad0ba4a74") : secret "kube-state-metrics-tls" not found
Jul 25 01:12:13.242694 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-tls\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k545\" (UniqueName: \"kubernetes.io/projected/d82fc6be-efaf-459f-9014-00745b51e6a6-kube-api-access-7k545\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-metrics-client-ca\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/505debb5-370d-42dc-aeda-2a2ad0ba4a74-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82fc6be-efaf-459f-9014-00745b51e6a6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ktnv\" (UniqueName: \"kubernetes.io/projected/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-api-access-4ktnv\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.242922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z479\" (UniqueName: \"kubernetes.io/projected/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-kube-api-access-4z479\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.243378 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.242966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.243378 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.243204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/505debb5-370d-42dc-aeda-2a2ad0ba4a74-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.243691 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.243654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.245556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.245528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.245556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.245555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82fc6be-efaf-459f-9014-00745b51e6a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.245723 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.245674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.250824 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.250801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k545\" (UniqueName: \"kubernetes.io/projected/d82fc6be-efaf-459f-9014-00745b51e6a6-kube-api-access-7k545\") pod \"openshift-state-metrics-b8f49f5c6-mh8bq\" (UID: \"d82fc6be-efaf-459f-9014-00745b51e6a6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.251025 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.251008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ktnv\" (UniqueName: \"kubernetes.io/projected/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-api-access-4ktnv\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.333711 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.333675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.343851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.343809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.343891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-textfile\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.343922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-tls\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.343951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-metrics-client-ca\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z479\" (UniqueName: \"kubernetes.io/projected/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-kube-api-access-4z479\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344259 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-wtmp\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344259 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-sys\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344259 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-root\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344259 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344438 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-wtmp\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344438 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-sys\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344438 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-root\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344603 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344603 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-textfile\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.344859 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.344833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-metrics-client-ca\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.346642 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.346621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.346905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.346887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-node-exporter-tls\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.352241 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.352210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z479\" (UniqueName: \"kubernetes.io/projected/7e9fb851-fd76-4d93-b7bc-791aa8bf4673-kube-api-access-4z479\") pod \"node-exporter-8vwx2\" (UID: \"7e9fb851-fd76-4d93-b7bc-791aa8bf4673\") " pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.401777 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.401741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"
Jul 25 01:12:13.433167 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.433128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.449927 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.449883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vwx2"
Jul 25 01:12:13.491122 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.491026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:13.747216 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.747120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.749808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.749785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/505debb5-370d-42dc-aeda-2a2ad0ba4a74-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5fd92\" (UID: \"505debb5-370d-42dc-aeda-2a2ad0ba4a74\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:13.903919 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:13.903865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:14.013703 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.013620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"
Jul 25 01:12:14.097722 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.097660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:14.164194 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.164163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:14.169831 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.169781    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:12:14.207715 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.207656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:12:14.207889 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.207839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.210110 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 25 01:12:14.210268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 25 01:12:14.210268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 25 01:12:14.210467 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210281    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 25 01:12:14.210467 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 25 01:12:14.210814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 25 01:12:14.210908 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210891    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-84hvl\""
Jul 25 01:12:14.210975 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.210911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 25 01:12:14.211174 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.211142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 25 01:12:14.211525 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.211375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 25 01:12:14.251546 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88c5b\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.251948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.252168 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.251949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.312350 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.312272    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:14.352523 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.352705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.352705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.352705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.352705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.352705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88c5b\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.352993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.353382 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:14.353209    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle podName:f58dda79-8f80-4d93-af91-d58dcefdae16 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:14.853182335 +0000 UTC m=+53.755827340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16") : configmap references non-existent config key: ca-bundle.crt
Jul 25 01:12:14.354878 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.353823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.354878 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.354290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.355987 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.355924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.356130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.356100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.356488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.356457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.356644 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.356622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.356806 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.356783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.357220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.357195    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.357293 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.357247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.357763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.357740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.358685 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.358666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.362352 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.362328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88c5b\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.857468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.857422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:14.858423 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:14.858391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:15.095367 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.095329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:15.114352 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.114264    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"]
Jul 25 01:12:15.122351 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.122326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:12:15.194321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.194288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:15.229000 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.228967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"]
Jul 25 01:12:15.229102 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.229091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.231381 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231339    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 25 01:12:15.231539 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 25 01:12:15.231539 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 25 01:12:15.231539 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 25 01:12:15.231715 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 25 01:12:15.231837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5rdouu62ar2h\""
Jul 25 01:12:15.231924 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.231910    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bbn5w\""
Jul 25 01:12:15.261050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84de3649-044b-4723-83ae-c6c4bc5df2ba-metrics-client-ca\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261257 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspw9\" (UniqueName: \"kubernetes.io/projected/84de3649-044b-4723-83ae-c6c4bc5df2ba-kube-api-access-mspw9\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261257 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261257 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-grpc-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.261370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.261314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.361959 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.361916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspw9\" (UniqueName: \"kubernetes.io/projected/84de3649-044b-4723-83ae-c6c4bc5df2ba-kube-api-access-mspw9\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.361959 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.361968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-grpc-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84de3649-044b-4723-83ae-c6c4bc5df2ba-metrics-client-ca\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.362221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.362213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.363186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.363153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84de3649-044b-4723-83ae-c6c4bc5df2ba-metrics-client-ca\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.364911 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.364820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.365014 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.364940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.365054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.365038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.365201 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.365177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.365201 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.365191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-grpc-tls\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.365497 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.365477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84de3649-044b-4723-83ae-c6c4bc5df2ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.368777 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.368758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspw9\" (UniqueName: \"kubernetes.io/projected/84de3649-044b-4723-83ae-c6c4bc5df2ba-kube-api-access-mspw9\") pod \"thanos-querier-6c8bd9446-mwpvs\" (UID: \"84de3649-044b-4723-83ae-c6c4bc5df2ba\") " pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:15.539331 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:15.539297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:16.016807 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.016758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:16.113849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.113810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:16.148686 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:16.148346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9fb851_fd76_4d93_b7bc_791aa8bf4673.slice/crio-fb5f07029046526c5c211f3306b389afcb982c77ff133d5a5742e7d8aa63ae9e WatchSource:0}: Error finding container fb5f07029046526c5c211f3306b389afcb982c77ff133d5a5742e7d8aa63ae9e: Status 404 returned error can't find the container with id fb5f07029046526c5c211f3306b389afcb982c77ff133d5a5742e7d8aa63ae9e
Jul 25 01:12:16.244652 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.244227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:16.310226 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.309887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:12:16.323786 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:16.323749    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58dda79_8f80_4d93_af91_d58dcefdae16.slice/crio-de8a983a36e6504ba39d003e628b4f9e6a9f0b1b8ce3b53ee3797804ee25dfb0 WatchSource:0}: Error finding container de8a983a36e6504ba39d003e628b4f9e6a9f0b1b8ce3b53ee3797804ee25dfb0: Status 404 returned error can't find the container with id de8a983a36e6504ba39d003e628b4f9e6a9f0b1b8ce3b53ee3797804ee25dfb0
Jul 25 01:12:16.352365 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.352339    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"]
Jul 25 01:12:16.356324 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:16.356287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84de3649_044b_4723_83ae_c6c4bc5df2ba.slice/crio-e0303cb9a2e4cdf9e6796d53183c2a3003fa264208a52d36a936095f6df600bd WatchSource:0}: Error finding container e0303cb9a2e4cdf9e6796d53183c2a3003fa264208a52d36a936095f6df600bd: Status 404 returned error can't find the container with id e0303cb9a2e4cdf9e6796d53183c2a3003fa264208a52d36a936095f6df600bd
Jul 25 01:12:16.531443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.531408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq"]
Jul 25 01:12:16.534305 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.534280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92"]
Jul 25 01:12:16.535429 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:16.535398    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82fc6be_efaf_459f_9014_00745b51e6a6.slice/crio-628e32ebcc688a492ebcd15c97d97787a814763bd2d8bb16074123479cbe3bdf WatchSource:0}: Error finding container 628e32ebcc688a492ebcd15c97d97787a814763bd2d8bb16074123479cbe3bdf: Status 404 returned error can't find the container with id 628e32ebcc688a492ebcd15c97d97787a814763bd2d8bb16074123479cbe3bdf
Jul 25 01:12:16.537224 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:16.537197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:17.024711 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.024675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8xpqk"
Jul 25 01:12:17.068894 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.068690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq" event={"ID":"d82fc6be-efaf-459f-9014-00745b51e6a6","Type":"ContainerStarted","Data":"f61c4d40796b3cf5dd6551c17c815d0e0032bfc4cb96c5863540a1db506ec3a2"}
Jul 25 01:12:17.068894 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.068769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq" event={"ID":"d82fc6be-efaf-459f-9014-00745b51e6a6","Type":"ContainerStarted","Data":"4ac3a5d530d997672def5bb69a92577d28f3c8b9fe828a9758834c751ea1f30a"}
Jul 25 01:12:17.068894 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.068798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq" event={"ID":"d82fc6be-efaf-459f-9014-00745b51e6a6","Type":"ContainerStarted","Data":"628e32ebcc688a492ebcd15c97d97787a814763bd2d8bb16074123479cbe3bdf"}
Jul 25 01:12:17.070693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.070581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"e0303cb9a2e4cdf9e6796d53183c2a3003fa264208a52d36a936095f6df600bd"}
Jul 25 01:12:17.075812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.075577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vwx2" event={"ID":"7e9fb851-fd76-4d93-b7bc-791aa8bf4673","Type":"ContainerStarted","Data":"1ccc2a79d00cfc38b20eedd21d45e84eab3007fe3d7970b7dce6674583f8432d"}
Jul 25 01:12:17.075812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.075640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vwx2" event={"ID":"7e9fb851-fd76-4d93-b7bc-791aa8bf4673","Type":"ContainerStarted","Data":"fb5f07029046526c5c211f3306b389afcb982c77ff133d5a5742e7d8aa63ae9e"}
Jul 25 01:12:17.078808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.078722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92" event={"ID":"505debb5-370d-42dc-aeda-2a2ad0ba4a74","Type":"ContainerStarted","Data":"78db1aa275f076856296e84b39b8d90bb0e87b3edda1c31699f724c88f803f77"}
Jul 25 01:12:17.081296 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.080958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"de8a983a36e6504ba39d003e628b4f9e6a9f0b1b8ce3b53ee3797804ee25dfb0"}
Jul 25 01:12:17.083547 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.083502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9npk" event={"ID":"11889849-9aca-4581-9ff2-c3e7174ff9a1","Type":"ContainerStarted","Data":"7528f29878b3c9f7fd65927d2545e77fe4d14cfbf95b84e6879576dcd9ee8f6d"}
Jul 25 01:12:17.485440 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.479395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"]
Jul 25 01:12:17.485440 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.482743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.485440 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.485089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"]
Jul 25 01:12:17.486575 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.486362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-43j1744rmu9ve\""
Jul 25 01:12:17.486575 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.486400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 25 01:12:17.486930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.486910    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 25 01:12:17.487708 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.487304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 25 01:12:17.487848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.486936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 25 01:12:17.490716 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.490693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jg8qb\""
Jul 25 01:12:17.586501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/418a6175-7129-4194-ac5d-c7062183a235-audit-log\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586717 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-tls\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586717 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfs67\" (UniqueName: \"kubernetes.io/projected/418a6175-7129-4194-ac5d-c7062183a235-kube-api-access-tfs67\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586717 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-metrics-server-audit-profiles\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586717 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-client-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586717 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-client-certs\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.586974 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.586731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.687874 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.687828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-client-certs\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688107 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.687893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688107 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.688059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/418a6175-7129-4194-ac5d-c7062183a235-audit-log\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688107 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.688097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-tls\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688377 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.688127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfs67\" (UniqueName: \"kubernetes.io/projected/418a6175-7129-4194-ac5d-c7062183a235-kube-api-access-tfs67\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688377 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.688192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-metrics-server-audit-profiles\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.688377 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.688217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-client-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.689155 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.689126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/418a6175-7129-4194-ac5d-c7062183a235-audit-log\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.689578 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.689549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.690460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.690429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/418a6175-7129-4194-ac5d-c7062183a235-metrics-server-audit-profiles\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.700215 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.700160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-client-ca-bundle\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.704408 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.704331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-client-certs\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.707494 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.707418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/418a6175-7129-4194-ac5d-c7062183a235-secret-metrics-server-tls\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.715161 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.715070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfs67\" (UniqueName: \"kubernetes.io/projected/418a6175-7129-4194-ac5d-c7062183a235-kube-api-access-tfs67\") pod \"metrics-server-5bf7bbb96c-kdqs7\" (UID: \"418a6175-7129-4194-ac5d-c7062183a235\") " pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.806469 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.806129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:17.837458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.837347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:17.845834 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.844741    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"]
Jul 25 01:12:17.847193 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.847167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:17.851740 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.851394    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2g4z9\""
Jul 25 01:12:17.851740 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.851426    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 25 01:12:17.859290 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.859213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"]
Jul 25 01:12:17.892129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.891872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:17.892129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.891966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnll\" (UniqueName: \"kubernetes.io/projected/786b5a2a-839f-49bd-898a-8c7c6c768ae4-kube-api-access-gsnll\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:17.993636 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.993533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:17.993636 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:17.993619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnll\" (UniqueName: \"kubernetes.io/projected/786b5a2a-839f-49bd-898a-8c7c6c768ae4-kube-api-access-gsnll\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:17.994340 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:17.994021    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 25 01:12:17.994340 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:12:17.994106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert podName:786b5a2a-839f-49bd-898a-8c7c6c768ae4 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:18.49408383 +0000 UTC m=+57.396728835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-dfmh6" (UID: "786b5a2a-839f-49bd-898a-8c7c6c768ae4") : secret "monitoring-plugin-cert" not found
Jul 25 01:12:18.006258 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.006206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnll\" (UniqueName: \"kubernetes.io/projected/786b5a2a-839f-49bd-898a-8c7c6c768ae4-kube-api-access-gsnll\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:18.082789 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.082739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:18.091808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.091747    2565 generic.go:356] "Generic (PLEG): container finished" podID="7e9fb851-fd76-4d93-b7bc-791aa8bf4673" containerID="1ccc2a79d00cfc38b20eedd21d45e84eab3007fe3d7970b7dce6674583f8432d" exitCode=0
Jul 25 01:12:18.091808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.091794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vwx2" event={"ID":"7e9fb851-fd76-4d93-b7bc-791aa8bf4673","Type":"ContainerDied","Data":"1ccc2a79d00cfc38b20eedd21d45e84eab3007fe3d7970b7dce6674583f8432d"}
Jul 25 01:12:18.092056 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.091884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vwx2" event={"ID":"7e9fb851-fd76-4d93-b7bc-791aa8bf4673","Type":"ContainerStarted","Data":"209a3bdfa78c6c7b660239f661faaaed7ac74d9ddea6b664ae854cda97a3a845"}
Jul 25 01:12:18.092056 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.091915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vwx2" event={"ID":"7e9fb851-fd76-4d93-b7bc-791aa8bf4673","Type":"ContainerStarted","Data":"380455914c058ac82d990b39616105e2f63d0630ca65e6ae2b55f3577efba931"}
Jul 25 01:12:18.109242 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.109080    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8vwx2" podStartSLOduration=4.26961437 podStartE2EDuration="5.109055755s" totalImagesPullingTime="747.209629ms" totalInitContainerRuntime="92.231756ms" isStatefulPod=true podCreationTimestamp="2026-07-25 01:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.107613014 +0000 UTC m=+57.010258025" watchObservedRunningTime="2026-07-25 01:12:18.109055755 +0000 UTC m=+57.011700767"
Jul 25 01:12:18.499529 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.499360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:18.502573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.502540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/786b5a2a-839f-49bd-898a-8c7c6c768ae4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dfmh6\" (UID: \"786b5a2a-839f-49bd-898a-8c7c6c768ae4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:18.578897 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.578856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:18.682810 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.682776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:18.763805 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:18.763711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:19.277654 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.277611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:19.279110 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.279083    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:12:19.284347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.284320    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.286537 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.286380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dzl9h\""
Jul 25 01:12:19.286537 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.286465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 25 01:12:19.286798 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.286462    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287011    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287193    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287249    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287353    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49nd7cq1ag55i\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.288135    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.288141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 25 01:12:19.288306 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.287706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 25 01:12:19.290455 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.290414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 25 01:12:19.293063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.293045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 25 01:12:19.300258 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.300227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:12:19.408299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408593 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctn9\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408593 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408593 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408940 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408940 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.408940 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409064 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409064 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.408984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409153 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409153 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409153 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409269 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409269 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.409269 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.409205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctn9\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.511994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.513075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.512727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.513204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.514398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.513676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.515365 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.515053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.515365 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.515320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.515595 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.515572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.516271 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.516245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.516680 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.516565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.518196 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.518175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.520430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.518646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.520430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.519182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.520430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.519286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.520430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.519735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.520430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.520275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.522763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.522737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.522864 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.522745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctn9\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.523472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.523276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.523472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.523434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.524125 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.524069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.525947 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.525905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:19.600650 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:19.600611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:20.455016 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.454968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:20.517498 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.517457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:20.570501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.570441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:20.739538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.739434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:20.811883 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.811847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:20.976528 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.976479    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"]
Jul 25 01:12:20.979778 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:20.979747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.083027 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.082986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.180086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.180046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.418846 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:21.418817    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418a6175_7129_4194_ac5d_c7062183a235.slice/crio-6af7ecb46a1ec929141aeca108972d7269d29e418c7affec1502ddebd74c8662 WatchSource:0}: Error finding container 6af7ecb46a1ec929141aeca108972d7269d29e418c7affec1502ddebd74c8662: Status 404 returned error can't find the container with id 6af7ecb46a1ec929141aeca108972d7269d29e418c7affec1502ddebd74c8662
Jul 25 01:12:21.526483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.526297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.629300 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.628938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.694147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.694111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"]
Jul 25 01:12:21.708583 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:21.705908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786b5a2a_839f_49bd_898a_8c7c6c768ae4.slice/crio-f7ee785fdf4a5b9149ff60718aa41350b73e24f0c9451a82a0cb9bc7ec0f5ccc WatchSource:0}: Error finding container f7ee785fdf4a5b9149ff60718aa41350b73e24f0c9451a82a0cb9bc7ec0f5ccc: Status 404 returned error can't find the container with id f7ee785fdf4a5b9149ff60718aa41350b73e24f0c9451a82a0cb9bc7ec0f5ccc
Jul 25 01:12:21.740592 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.740569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:12:21.743332 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:21.743286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c88d06e_eb54_4351_9b22_06fc9885bbd4.slice/crio-a994123680f28fcef30fa2d2545c73010ff5b6512b60a3d5d6d284294f8b0354 WatchSource:0}: Error finding container a994123680f28fcef30fa2d2545c73010ff5b6512b60a3d5d6d284294f8b0354: Status 404 returned error can't find the container with id a994123680f28fcef30fa2d2545c73010ff5b6512b60a3d5d6d284294f8b0354
Jul 25 01:12:21.744483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.744378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.845647 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.845561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:21.945238 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:21.945146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:22.116367 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.116332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq" event={"ID":"d82fc6be-efaf-459f-9014-00745b51e6a6","Type":"ContainerStarted","Data":"2734fb57a43bfc2be94cc76e538d61d39b2cb3c485de74117c88bd069e2e5e14"}
Jul 25 01:12:22.119783 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.119742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"27e90e07c4d80a153b95298668c09959815c946855ed11cdcb157bfc3defe17e"}
Jul 25 01:12:22.119953 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.119819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"2eb76f99a8cf1f731837677e1d1a3ce30ca6631598a6c4170435486b54b2585a"}
Jul 25 01:12:22.119953 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.119854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"9af8535a7a0c9deb22dc83a09104c08394a664e313023e10181006586f01592a"}
Jul 25 01:12:22.122744 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.122713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92" event={"ID":"505debb5-370d-42dc-aeda-2a2ad0ba4a74","Type":"ContainerStarted","Data":"a6e8a89a05ec7359a6136b7b0ba98952d25f6ad27e2bb16e734a3713d107d0b3"}
Jul 25 01:12:22.122886 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.122777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92" event={"ID":"505debb5-370d-42dc-aeda-2a2ad0ba4a74","Type":"ContainerStarted","Data":"936112edaa5451943d49f342b883aa7e4ed416ec11d4ea28eea5ae90fbdbcc95"}
Jul 25 01:12:22.122886 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.122815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92" event={"ID":"505debb5-370d-42dc-aeda-2a2ad0ba4a74","Type":"ContainerStarted","Data":"a487f9ad54b0a63d8debf5a58bed66dc63580261eb1d6bf685ffd5c7360e2c4f"}
Jul 25 01:12:22.125240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.125209    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b" exitCode=0
Jul 25 01:12:22.125569 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.125547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b"}
Jul 25 01:12:22.127896 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.127872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9npk" event={"ID":"11889849-9aca-4581-9ff2-c3e7174ff9a1","Type":"ContainerStarted","Data":"e8a24ee154e613d2c328b99e4f80bf7d2cb1296fbc6c764d3e42ed74cafc8101"}
Jul 25 01:12:22.130237 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.130214    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1" exitCode=0
Jul 25 01:12:22.130385 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.130329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"}
Jul 25 01:12:22.130452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.130401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"a994123680f28fcef30fa2d2545c73010ff5b6512b60a3d5d6d284294f8b0354"}
Jul 25 01:12:22.133876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.133823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6" event={"ID":"786b5a2a-839f-49bd-898a-8c7c6c768ae4","Type":"ContainerStarted","Data":"f7ee785fdf4a5b9149ff60718aa41350b73e24f0c9451a82a0cb9bc7ec0f5ccc"}
Jul 25 01:12:22.136724 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.136672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7" event={"ID":"418a6175-7129-4194-ac5d-c7062183a235","Type":"ContainerStarted","Data":"6af7ecb46a1ec929141aeca108972d7269d29e418c7affec1502ddebd74c8662"}
Jul 25 01:12:22.140126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.140087    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mh8bq" podStartSLOduration=4.400517227 podStartE2EDuration="9.140070664s" totalImagesPullingTime="4.739553437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:22.138400146 +0000 UTC m=+61.041045158" watchObservedRunningTime="2026-07-25 01:12:22.140070664 +0000 UTC m=+61.042715674"
Jul 25 01:12:22.152974 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.152935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:22.160227 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.160162    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5fd92" podStartSLOduration=4.287649849 podStartE2EDuration="9.160138728s" totalImagesPullingTime="4.872488879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:22.158041493 +0000 UTC m=+61.060686506" watchObservedRunningTime="2026-07-25 01:12:22.160138728 +0000 UTC m=+61.062783744"
Jul 25 01:12:22.269545 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.269387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:22.582802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.582765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:22.983436 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:22.982443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwbzb"
Jul 25 01:12:23.092955 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:23.092811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:23.161206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:23.161104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:23.742317 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:23.742048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:23.810826 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:23.810734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:27.323669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.323618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:12:27.325914 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.325884    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 25 01:12:27.337080 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.337049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f47eaa5-0859-40b6-a4df-3b2c764a6577-metrics-certs\") pod \"network-metrics-daemon-s4tph\" (UID: \"9f47eaa5-0859-40b6-a4df-3b2c764a6577\") " pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:12:27.424637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.424128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:12:27.424637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.424202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:27.426167 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.426141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 25 01:12:27.426273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.426248    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 25 01:12:27.437269 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.437236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 25 01:12:27.438304 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.438281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d442b8-e39e-4173-a424-36af1e358299-original-pull-secret\") pod \"global-pull-secret-syncer-lgctr\" (UID: \"84d442b8-e39e-4173-a424-36af1e358299\") " pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:12:27.448614 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.448591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dnf\" (UniqueName: \"kubernetes.io/projected/5857c619-3642-4479-8c6b-4d287583eb43-kube-api-access-r2dnf\") pod \"network-check-target-8qwmp\" (UID: \"5857c619-3642-4479-8c6b-4d287583eb43\") " pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:27.552868 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.552787    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4ttp\""
Jul 25 01:12:27.561130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.561080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:27.565263 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.564982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djkst\""
Jul 25 01:12:27.573356 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.573126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s4tph"
Jul 25 01:12:27.665755 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.664009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgctr"
Jul 25 01:12:27.793162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.790581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qwmp"]
Jul 25 01:12:27.820592 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:27.819954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5857c619_3642_4479_8c6b_4d287583eb43.slice/crio-d300aa91b1db8c2e5db1c742e4bf510119ebd8dbcad4cd8da2b1d70f0e5e46e0 WatchSource:0}: Error finding container d300aa91b1db8c2e5db1c742e4bf510119ebd8dbcad4cd8da2b1d70f0e5e46e0: Status 404 returned error can't find the container with id d300aa91b1db8c2e5db1c742e4bf510119ebd8dbcad4cd8da2b1d70f0e5e46e0
Jul 25 01:12:27.883358 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.883269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s4tph"]
Jul 25 01:12:27.895029 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:12:27.894976    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f47eaa5_0859_40b6_a4df_3b2c764a6577.slice/crio-bc9fad0574830d0eb1c4271425cc18dbbe25fcc894b14ffe797a095c8aca0a6b WatchSource:0}: Error finding container bc9fad0574830d0eb1c4271425cc18dbbe25fcc894b14ffe797a095c8aca0a6b: Status 404 returned error can't find the container with id bc9fad0574830d0eb1c4271425cc18dbbe25fcc894b14ffe797a095c8aca0a6b
Jul 25 01:12:27.960796 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:27.960765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgctr"]
Jul 25 01:12:28.171865 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.171831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6" event={"ID":"786b5a2a-839f-49bd-898a-8c7c6c768ae4","Type":"ContainerStarted","Data":"bf3fd83e6738e158f69ec5ad044646c339052545726a4b866024c727718f4f8a"}
Jul 25 01:12:28.172063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.172036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:28.173223 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.173193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgctr" event={"ID":"84d442b8-e39e-4173-a424-36af1e358299","Type":"ContainerStarted","Data":"624e284f7046e12e0fe569b834049d52666019ce36a52a3c04469a66cd43c9ad"}
Jul 25 01:12:28.174902 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.174875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7" event={"ID":"418a6175-7129-4194-ac5d-c7062183a235","Type":"ContainerStarted","Data":"9897990e07854d8c366ae2adf124d1b44fa3ade381a634554acecb0e900f4b37"}
Jul 25 01:12:28.176073 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.176033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s4tph" event={"ID":"9f47eaa5-0859-40b6-a4df-3b2c764a6577","Type":"ContainerStarted","Data":"bc9fad0574830d0eb1c4271425cc18dbbe25fcc894b14ffe797a095c8aca0a6b"}
Jul 25 01:12:28.177247 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.177222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qwmp" event={"ID":"5857c619-3642-4479-8c6b-4d287583eb43","Type":"ContainerStarted","Data":"d300aa91b1db8c2e5db1c742e4bf510119ebd8dbcad4cd8da2b1d70f0e5e46e0"}
Jul 25 01:12:28.178031 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.178015    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6"
Jul 25 01:12:28.180245 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.180223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"16409219858b360464381d19877542b598c4a29c9addf964928567b13fb6d656"}
Jul 25 01:12:28.180328 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.180273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"3211b13598e5a9b97ef7bacc88db2bc9ef43f59d6546e399a9e98360b917a7e9"}
Jul 25 01:12:28.180328 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.180300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" event={"ID":"84de3649-044b-4723-83ae-c6c4bc5df2ba","Type":"ContainerStarted","Data":"cd2fa528bcd9b4d4d17cf74d8ad0a8b9c685fd12866c09c02fea17a7b09364db"}
Jul 25 01:12:28.180455 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.180344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:28.183951 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.183923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"}
Jul 25 01:12:28.184029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.183985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"}
Jul 25 01:12:28.184029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.184022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"}
Jul 25 01:12:28.184106 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.184051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"}
Jul 25 01:12:28.184106 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.184075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"}
Jul 25 01:12:28.184168 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.184113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerStarted","Data":"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"}
Jul 25 01:12:28.186048 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.185981    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dfmh6" podStartSLOduration=5.489552734 podStartE2EDuration="11.185863751s" totalImagesPullingTime="5.696311017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.184837885 +0000 UTC m=+67.087482900" watchObservedRunningTime="2026-07-25 01:12:28.185863751 +0000 UTC m=+67.088508763"
Jul 25 01:12:28.186815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.186795    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs"
Jul 25 01:12:28.187382 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.187358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9npk" event={"ID":"11889849-9aca-4581-9ff2-c3e7174ff9a1","Type":"ContainerStarted","Data":"5dad1b56b06c0875b54bafe43137cd1d9465a26f031b1c9b922030c3d13b3ffb"}
Jul 25 01:12:28.191386 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"}
Jul 25 01:12:28.191468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"}
Jul 25 01:12:28.191468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"}
Jul 25 01:12:28.191468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"}
Jul 25 01:12:28.191609 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"}
Jul 25 01:12:28.191609 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.191525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerStarted","Data":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"}
Jul 25 01:12:28.209535 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.209434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c8bd9446-mwpvs" podStartSLOduration=2.5784498559999998 podStartE2EDuration="13.209412063s" totalImagesPullingTime="10.630962207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.202158049 +0000 UTC m=+67.104803062" watchObservedRunningTime="2026-07-25 01:12:28.209412063 +0000 UTC m=+67.112057076"
Jul 25 01:12:28.224642 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.224584    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7" podStartSLOduration=5.236996077 podStartE2EDuration="11.224565515s" totalImagesPullingTime="5.987569438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.222380728 +0000 UTC m=+67.125025738" watchObservedRunningTime="2026-07-25 01:12:28.224565515 +0000 UTC m=+67.127210525"
Jul 25 01:12:28.247592 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.247496    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.44819938 podStartE2EDuration="14.247477065s" totalImagesPullingTime="9.769341572s" totalInitContainerRuntime="29.936113ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.245842749 +0000 UTC m=+67.148487773" watchObservedRunningTime="2026-07-25 01:12:28.247477065 +0000 UTC m=+67.150122074"
Jul 25 01:12:28.290753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.290687    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.9624736670000003 podStartE2EDuration="9.290662414s" totalImagesPullingTime="5.295644159s" totalInitContainerRuntime="32.544588ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.289058894 +0000 UTC m=+67.191703910" watchObservedRunningTime="2026-07-25 01:12:28.290662414 +0000 UTC m=+67.193307425"
Jul 25 01:12:28.305953 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:28.305896    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z9npk" podStartSLOduration=9.971988422 podStartE2EDuration="26.305877203s" totalImagesPullingTime="16.333888781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:12:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:28.304800807 +0000 UTC m=+67.207445820" watchObservedRunningTime="2026-07-25 01:12:28.305877203 +0000 UTC m=+67.208522215"
Jul 25 01:12:29.117903 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.117799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:29.201452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.201248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s4tph" event={"ID":"9f47eaa5-0859-40b6-a4df-3b2c764a6577","Type":"ContainerStarted","Data":"73b2ae2fd56ae5e5329645776d597949e926c69e06b5e4e3bd47e1f8ed165caa"}
Jul 25 01:12:29.201452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.201350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s4tph" event={"ID":"9f47eaa5-0859-40b6-a4df-3b2c764a6577","Type":"ContainerStarted","Data":"2e827294b3db540b906ae24a5fb5bef7a6b9027d769b237c76fa677a87781a5c"}
Jul 25 01:12:29.220276 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.220026    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s4tph" podStartSLOduration=66.212859751 podStartE2EDuration="1m7.220002767s" totalImagesPullingTime="1.007143016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:29.219299461 +0000 UTC m=+68.121944473" watchObservedRunningTime="2026-07-25 01:12:29.220002767 +0000 UTC m=+68.122647779"
Jul 25 01:12:29.220607 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.220488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:29.316483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.316262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:29.418204 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.418136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:29.601077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:29.601035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:12:30.039781 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:30.039690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:30.093896 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:30.093857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:31.600295 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:31.600249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:31.701477 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:31.701438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:33.221724 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:33.221685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qwmp" event={"ID":"5857c619-3642-4479-8c6b-4d287583eb43","Type":"ContainerStarted","Data":"993c2b6169e4d8c7802a418c413dd609572098caa6f3665ae5f1cd73bf91a2ce"}
Jul 25 01:12:33.222206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:33.221772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:12:33.223432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:33.223409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgctr" event={"ID":"84d442b8-e39e-4173-a424-36af1e358299","Type":"ContainerStarted","Data":"fb786995ee1309820b6892337e104fc2157190903e2cf5e746f808b839c410c3"}
Jul 25 01:12:33.236187 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:33.236137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8qwmp" podStartSLOduration=66.462592779 podStartE2EDuration="1m11.2361211s" totalImagesPullingTime="4.773528321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:33.234645113 +0000 UTC m=+72.137290124" watchObservedRunningTime="2026-07-25 01:12:33.2361211 +0000 UTC m=+72.138766111"
Jul 25 01:12:33.247336 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:33.247278    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lgctr" podStartSLOduration=66.605420545 podStartE2EDuration="1m11.247259287s" totalImagesPullingTime="4.641838742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:33.246737981 +0000 UTC m=+72.149382992" watchObservedRunningTime="2026-07-25 01:12:33.247259287 +0000 UTC m=+72.149904298"
Jul 25 01:12:35.141973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:35.141933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:37.807037 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:37.806993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:37.807433 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:37.807065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:38.343073 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:38.343029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:38.443146 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:38.443093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:41.139560 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:41.139522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:41.240749 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:41.240715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:44.347461 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:44.347299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:44.447856 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:44.447823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:45.047840 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:45.047802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:45.149812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:45.149778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:46.170491 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:46.170457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:12:57.813147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:57.813110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:12:57.817172 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:12:57.817144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bf7bbb96c-kdqs7"
Jul 25 01:13:04.231814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:04.231772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8qwmp"
Jul 25 01:13:12.946432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:12.946388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:12.967041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:12.967007    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:13.405607 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:13.405578    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:22.302092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:22.302051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:22.821483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:22.821444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:23.359394 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359355    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:23.359906 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359821    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="alertmanager" containerID="cri-o://73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665" gracePeriod=120
Jul 25 01:13:23.359906 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359862    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-metric" containerID="cri-o://3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43" gracePeriod=120
Jul 25 01:13:23.360021 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359883    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-web" containerID="cri-o://17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d" gracePeriod=120
Jul 25 01:13:23.360021 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359907    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy" containerID="cri-o://03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4" gracePeriod=120
Jul 25 01:13:23.360021 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359961    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="config-reloader" containerID="cri-o://7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72" gracePeriod=120
Jul 25 01:13:23.360021 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:23.359870    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="prom-label-proxy" containerID="cri-o://cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9" gracePeriod=120
Jul 25 01:13:24.437768 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437735    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9" exitCode=0
Jul 25 01:13:24.437768 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437761    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43" exitCode=0
Jul 25 01:13:24.437768 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437773    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4" exitCode=0
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437782    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72" exitCode=0
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437791    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665" exitCode=0
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"}
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"}
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"}
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"}
Jul 25 01:13:24.438220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.437953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"}
Jul 25 01:13:24.620499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.620469    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:24.656792 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656804    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656920    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.656973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.656957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88c5b\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657076    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657103    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out\") pod \"f58dda79-8f80-4d93-af91-d58dcefdae16\" (UID: \"f58dda79-8f80-4d93-af91-d58dcefdae16\") "
Jul 25 01:13:24.657894 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.657857    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:24.658735 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.658278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:13:24.659058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.659021    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:24.662096 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.662046    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:13:24.662427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.662385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.662831 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.662783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.663205 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.663170    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b" (OuterVolumeSpecName: "kube-api-access-88c5b") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "kube-api-access-88c5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:13:24.663401 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.663370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.663478 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.663421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume" (OuterVolumeSpecName: "config-volume") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.663478 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.663440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out" (OuterVolumeSpecName: "config-out") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:13:24.664032 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.663971    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.672300 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.672260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.678529 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.678479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config" (OuterVolumeSpecName: "web-config") pod "f58dda79-8f80-4d93-af91-d58dcefdae16" (UID: "f58dda79-8f80-4d93-af91-d58dcefdae16"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758163    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758205    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-tls-assets\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758217    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-cluster-tls-config\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758228    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-main-db\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758239    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758248    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88c5b\" (UniqueName: \"kubernetes.io/projected/f58dda79-8f80-4d93-af91-d58dcefdae16-kube-api-access-88c5b\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758256    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758264 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758264    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f58dda79-8f80-4d93-af91-d58dcefdae16-metrics-client-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758274    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-main-tls\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758284    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-web-config\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758292    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f58dda79-8f80-4d93-af91-d58dcefdae16-config-out\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758300    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:24.758664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:24.758307    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f58dda79-8f80-4d93-af91-d58dcefdae16-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:25.445499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.445462    2565 generic.go:356] "Generic (PLEG): container finished" podID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerID="17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d" exitCode=0
Jul 25 01:13:25.445925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.445542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"}
Jul 25 01:13:25.445925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.445587    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.445925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.445619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f58dda79-8f80-4d93-af91-d58dcefdae16","Type":"ContainerDied","Data":"de8a983a36e6504ba39d003e628b4f9e6a9f0b1b8ce3b53ee3797804ee25dfb0"}
Jul 25 01:13:25.445925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.445656    2565 scope.go:117] "RemoveContainer" containerID="cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"
Jul 25 01:13:25.454644 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.454623    2565 scope.go:117] "RemoveContainer" containerID="3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"
Jul 25 01:13:25.462590 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.462566    2565 scope.go:117] "RemoveContainer" containerID="03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"
Jul 25 01:13:25.470763 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.470733    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:25.471095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.471061    2565 scope.go:117] "RemoveContainer" containerID="17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"
Jul 25 01:13:25.475786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.475762    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:25.479139 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.479018    2565 scope.go:117] "RemoveContainer" containerID="7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"
Jul 25 01:13:25.486683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.486665    2565 scope.go:117] "RemoveContainer" containerID="73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"
Jul 25 01:13:25.495057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.495035    2565 scope.go:117] "RemoveContainer" containerID="a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b"
Jul 25 01:13:25.498750 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.498725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:25.499026 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499014    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-web"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499027    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-web"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499037    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="init-config-reloader"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="init-config-reloader"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499050    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="config-reloader"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499056    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="config-reloader"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499064    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy"
Jul 25 01:13:25.499070 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499070    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499075    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="prom-label-proxy"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499081    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="prom-label-proxy"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="alertmanager"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499103    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="alertmanager"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499110    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-metric"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499115    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-metric"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499159    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499166    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="alertmanager"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499172    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="prom-label-proxy"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499178    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-web"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499184    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="kube-rbac-proxy-metric"
Jul 25 01:13:25.499262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.499189    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" containerName="config-reloader"
Jul 25 01:13:25.503092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.503072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.503754 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.503738    2565 scope.go:117] "RemoveContainer" containerID="cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"
Jul 25 01:13:25.504148 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.504122    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9\": container with ID starting with cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9 not found: ID does not exist" containerID="cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"
Jul 25 01:13:25.504206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504159    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9"} err="failed to get container status \"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9\": rpc error: code = NotFound desc = could not find container \"cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9\": container with ID starting with cbd18bea879a1fa57012d285d028590253d2c855dfbd896be83de48aad529ff9 not found: ID does not exist"
Jul 25 01:13:25.504254 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504213    2565 scope.go:117] "RemoveContainer" containerID="3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"
Jul 25 01:13:25.504588 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.504566    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43\": container with ID starting with 3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43 not found: ID does not exist" containerID="3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"
Jul 25 01:13:25.504678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504593    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43"} err="failed to get container status \"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43\": rpc error: code = NotFound desc = could not find container \"3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43\": container with ID starting with 3c2d9cf7cffa35073be3677a7a366e63780e6f0994a780b5001bc4c763f7bc43 not found: ID does not exist"
Jul 25 01:13:25.504678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504613    2565 scope.go:117] "RemoveContainer" containerID="03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"
Jul 25 01:13:25.504906 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 25 01:13:25.505032 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.504920    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4\": container with ID starting with 03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4 not found: ID does not exist" containerID="03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"
Jul 25 01:13:25.505032 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504958    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4"} err="failed to get container status \"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4\": rpc error: code = NotFound desc = could not find container \"03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4\": container with ID starting with 03ef6b28d6bedf96a7e53cb317f1c12ee282334665c5e57faf4b47a90db6d8d4 not found: ID does not exist"
Jul 25 01:13:25.505032 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.504999    2565 scope.go:117] "RemoveContainer" containerID="17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"
Jul 25 01:13:25.505348 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.505319    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d\": container with ID starting with 17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d not found: ID does not exist" containerID="17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"
Jul 25 01:13:25.505422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 25 01:13:25.505422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 25 01:13:25.505422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505357    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d"} err="failed to get container status \"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d\": rpc error: code = NotFound desc = could not find container \"17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d\": container with ID starting with 17253e56fb88e823a23fa9a3dbac9adefaf82e16b67bc8c013e611c7e577d14d not found: ID does not exist"
Jul 25 01:13:25.505422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505381    2565 scope.go:117] "RemoveContainer" containerID="7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"
Jul 25 01:13:25.505696 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 25 01:13:25.505948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505753    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 25 01:13:25.505948 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.505815    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72\": container with ID starting with 7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72 not found: ID does not exist" containerID="7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"
Jul 25 01:13:25.505948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505845    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72"} err="failed to get container status \"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72\": rpc error: code = NotFound desc = could not find container \"7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72\": container with ID starting with 7d9a133935d9e97bd9205a1d0da4cc1e0abd92ac6de517a883c9178da1db8c72 not found: ID does not exist"
Jul 25 01:13:25.505948 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505867    2565 scope.go:117] "RemoveContainer" containerID="73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"
Jul 25 01:13:25.506162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 25 01:13:25.506162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.505991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 25 01:13:25.506162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.506071    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 25 01:13:25.506314 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.506154    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665\": container with ID starting with 73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665 not found: ID does not exist" containerID="73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"
Jul 25 01:13:25.506314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.506181    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665"} err="failed to get container status \"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665\": rpc error: code = NotFound desc = could not find container \"73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665\": container with ID starting with 73331ff193d811838c2753db2106f9b7f0f27cd69250066c23988bbbd02c8665 not found: ID does not exist"
Jul 25 01:13:25.506314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.506210    2565 scope.go:117] "RemoveContainer" containerID="a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b"
Jul 25 01:13:25.506457 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.506327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-84hvl\""
Jul 25 01:13:25.506696 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:25.506675    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b\": container with ID starting with a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b not found: ID does not exist" containerID="a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b"
Jul 25 01:13:25.506753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.506704    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b"} err="failed to get container status \"a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b\": rpc error: code = NotFound desc = could not find container \"a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b\": container with ID starting with a83cac7afb8c1bd90bae973fc577d9ff9f78ba39e4b187aa7eec45be9a0cd35b not found: ID does not exist"
Jul 25 01:13:25.509965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.509947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 25 01:13:25.515949 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.515926    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:25.565949 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.565904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.565949 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.565951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566146 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-web-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566146 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566146 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566146 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-config-volume\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566299 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-config-out\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566413 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgz8\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-kube-api-access-mfgz8\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566413 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.566413 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.566355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.644443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.644406    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f58dda79-8f80-4d93-af91-d58dcefdae16" path="/var/lib/kubelet/pods/f58dda79-8f80-4d93-af91-d58dcefdae16/volumes"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-web-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-config-volume\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-config-out\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.667934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgz8\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-kube-api-access-mfgz8\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.668284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.672793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.669653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.673814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.673406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.673901 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.673870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29ca699-5c38-42f3-bffd-709a001f0187-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.674147 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.674011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.674607 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.674454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-config-volume\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.675850 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.675822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.675960 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.675895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b29ca699-5c38-42f3-bffd-709a001f0187-config-out\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.676170 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.676146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.676905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.676874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgz8\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-kube-api-access-mfgz8\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.677010 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.676921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.677354 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.677336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b29ca699-5c38-42f3-bffd-709a001f0187-web-config\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.677549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.677533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b29ca699-5c38-42f3-bffd-709a001f0187-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b29ca699-5c38-42f3-bffd-709a001f0187\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.813089 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.812992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 25 01:13:25.961721 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:25.961636    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 25 01:13:25.965551 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:13:25.965521    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29ca699_5c38_42f3_bffd_709a001f0187.slice/crio-9a730cb34d45978e043ee215dcb03941bc1358bc890a661bb43244ff1d384ab0 WatchSource:0}: Error finding container 9a730cb34d45978e043ee215dcb03941bc1358bc890a661bb43244ff1d384ab0: Status 404 returned error can't find the container with id 9a730cb34d45978e043ee215dcb03941bc1358bc890a661bb43244ff1d384ab0
Jul 25 01:13:26.452551 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:26.452518    2565 generic.go:356] "Generic (PLEG): container finished" podID="b29ca699-5c38-42f3-bffd-709a001f0187" containerID="02f43148ebdf9923e31ed11e24a7a28c21d38338797b80da2ca7afc07a0d6e86" exitCode=0
Jul 25 01:13:26.452954 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:26.452586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerDied","Data":"02f43148ebdf9923e31ed11e24a7a28c21d38338797b80da2ca7afc07a0d6e86"}
Jul 25 01:13:26.452954 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:26.452639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"9a730cb34d45978e043ee215dcb03941bc1358bc890a661bb43244ff1d384ab0"}
Jul 25 01:13:27.415009 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.414974    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b66d4556b-krm8w"]
Jul 25 01:13:27.418303 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.418272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.420461 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.420434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 25 01:13:27.420634 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.420434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 25 01:13:27.420634 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.420526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 25 01:13:27.420950 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.420909    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sd6qr\""
Jul 25 01:13:27.421085 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.421065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 25 01:13:27.421407 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.421384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 25 01:13:27.424786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.424764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 25 01:13:27.430054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.430029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b66d4556b-krm8w"]
Jul 25 01:13:27.461690 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"cd744474db4256194ba320d35eb01e195eefcc879851e04266f78afecafd2157"}
Jul 25 01:13:27.462063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"c50c004948c700aa9d55ec01157fa9f4d7ec0540cf195f01e1456aa2befbad70"}
Jul 25 01:13:27.462063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"32fb6cb5194f8a49cadedab5533dac056784485ca21305b342e6f3e717572591"}
Jul 25 01:13:27.462063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"636e6a3ed8aa8b32f193ec95856a6b8ef54b19b85f0f2ba8fb30498ffa79fec7"}
Jul 25 01:13:27.462063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"e4d6fac78b7cdebfb195ab57a5dc62c1852cbd2de8cbc2356e606788cb9f34eb"}
Jul 25 01:13:27.462063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.461836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b29ca699-5c38-42f3-bffd-709a001f0187","Type":"ContainerStarted","Data":"38b0ec4c2391a8831438cef9c55c32ff7c3f776cc6ffc72dd8bb21fc4c82e955"}
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.485811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-metrics-client-ca\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.485860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.485957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-serving-certs-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.486009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.486035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-federate-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.486098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.486214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-476nq\" (UniqueName: \"kubernetes.io/projected/27665c84-9499-49f7-ab0b-45f1f214702a-kube-api-access-476nq\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.488340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.486252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.489538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.489458    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.474035585 podStartE2EDuration="2.489435767s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.400182ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:27.48724942 +0000 UTC m=+126.389894468" watchObservedRunningTime="2026-07-25 01:13:27.489435767 +0000 UTC m=+126.392080780"
Jul 25 01:13:27.587797 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.587745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-serving-certs-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588005 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.587824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588005 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.587853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-federate-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588005 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.587896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588005 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.587964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-476nq\" (UniqueName: \"kubernetes.io/projected/27665c84-9499-49f7-ab0b-45f1f214702a-kube-api-access-476nq\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.588006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.588062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-metrics-client-ca\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.588206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.588091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.590023 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.589994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.590287 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.590257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-metrics-client-ca\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.590409 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.590306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27665c84-9499-49f7-ab0b-45f1f214702a-serving-certs-ca-bundle\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.592584 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.592550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.592699 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.592613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-telemeter-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.592699 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.592623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.592818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.592795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/27665c84-9499-49f7-ab0b-45f1f214702a-federate-client-tls\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.598776 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.597208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-476nq\" (UniqueName: \"kubernetes.io/projected/27665c84-9499-49f7-ab0b-45f1f214702a-kube-api-access-476nq\") pod \"telemeter-client-6b66d4556b-krm8w\" (UID: \"27665c84-9499-49f7-ab0b-45f1f214702a\") " pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.730928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.730823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w"
Jul 25 01:13:27.736439 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.736401    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:27.736942 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.736872    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="prometheus" containerID="cri-o://f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723" gracePeriod=600
Jul 25 01:13:27.737385 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.737347    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3" gracePeriod=600
Jul 25 01:13:27.737496 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.737477    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy" containerID="cri-o://e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892" gracePeriod=600
Jul 25 01:13:27.737590 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.737576    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-web" containerID="cri-o://550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21" gracePeriod=600
Jul 25 01:13:27.737669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.737653    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="thanos-sidecar" containerID="cri-o://fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6" gracePeriod=600
Jul 25 01:13:27.737782 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.737728    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="config-reloader" containerID="cri-o://9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae" gracePeriod=600
Jul 25 01:13:27.940345 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:27.940312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b66d4556b-krm8w"]
Jul 25 01:13:27.943784 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:13:27.943756    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27665c84_9499_49f7_ab0b_45f1f214702a.slice/crio-7f2c046428ff1672e9169733e95272d0be332372497fd7eaea35e66a35a45a3a WatchSource:0}: Error finding container 7f2c046428ff1672e9169733e95272d0be332372497fd7eaea35e66a35a45a3a: Status 404 returned error can't find the container with id 7f2c046428ff1672e9169733e95272d0be332372497fd7eaea35e66a35a45a3a
Jul 25 01:13:28.009467 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.009441    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.094029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.093998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ctn9\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.094733 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.094733 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094605    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094733 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094650    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094733 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094685    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094735    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094807    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.094928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094892    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.094991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095085    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets\") pod \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\" (UID: \"7c88d06e-eb54-4351-9b22-06fc9885bbd4\") "
Jul 25 01:13:28.095500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095266    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.095500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095419    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.095500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095440    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.095500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.095456    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-metrics-client-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.096166 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.096087    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.097050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.096941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.097159 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.097108    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.097641 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.097613    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:13:28.098421 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.098384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:13:28.101764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.100414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.101764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.101696    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out" (OuterVolumeSpecName: "config-out") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:13:28.101764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.101749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9" (OuterVolumeSpecName: "kube-api-access-8ctn9") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "kube-api-access-8ctn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:13:28.101764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.101755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config" (OuterVolumeSpecName: "config") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102233 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:13:28.102400 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102455    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.102909 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.102889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.113638 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.113599    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config" (OuterVolumeSpecName: "web-config") pod "7c88d06e-eb54-4351-9b22-06fc9885bbd4" (UID: "7c88d06e-eb54-4351-9b22-06fc9885bbd4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:13:28.196268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196237    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-metrics-client-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196263    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-db\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196272    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196284    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196293    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config-out\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196304    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196313    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-tls-assets\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196321    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-config\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196329    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ctn9\" (UniqueName: \"kubernetes.io/projected/7c88d06e-eb54-4351-9b22-06fc9885bbd4-kube-api-access-8ctn9\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196338    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196347    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196356    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-web-config\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196364    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-kube-rbac-proxy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196372    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-grpc-tls\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196379    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196389    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c88d06e-eb54-4351-9b22-06fc9885bbd4-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.196493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.196397    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c88d06e-eb54-4351-9b22-06fc9885bbd4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:13:28.467157 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.467122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w" event={"ID":"27665c84-9499-49f7-ab0b-45f1f214702a","Type":"ContainerStarted","Data":"7f2c046428ff1672e9169733e95272d0be332372497fd7eaea35e66a35a45a3a"}
Jul 25 01:13:28.470530 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470492    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3" exitCode=0
Jul 25 01:13:28.470530 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470527    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892" exitCode=0
Jul 25 01:13:28.470530 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470533    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21" exitCode=0
Jul 25 01:13:28.470530 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470539    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6" exitCode=0
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470544    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae" exitCode=0
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470550    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723" exitCode=0
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"}
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470591    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"}
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"}
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470661    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"}
Jul 25 01:13:28.470771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"}
Jul 25 01:13:28.471066 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"}
Jul 25 01:13:28.471066 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.470817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c88d06e-eb54-4351-9b22-06fc9885bbd4","Type":"ContainerDied","Data":"a994123680f28fcef30fa2d2545c73010ff5b6512b60a3d5d6d284294f8b0354"}
Jul 25 01:13:28.478974 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.478931    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.486487 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.486468    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.492785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.492760    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:28.494631 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.494612    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.499551 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.499527    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:28.504814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.504797    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.514267 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.514231    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.523938 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.523910    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:28.524329 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524310    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-web"
Jul 25 01:13:28.524393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524332    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-web"
Jul 25 01:13:28.524393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524354    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="init-config-reloader"
Jul 25 01:13:28.524393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524365    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="init-config-reloader"
Jul 25 01:13:28.524393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524375    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="prometheus"
Jul 25 01:13:28.524393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524385    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="prometheus"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524396    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-thanos"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524404    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-thanos"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524416    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="config-reloader"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524421    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="config-reloader"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524427    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="thanos-sidecar"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524435    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="thanos-sidecar"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524374    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524450    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy"
Jul 25 01:13:28.524583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524458    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524652    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524666    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-thanos"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524678    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="kube-rbac-proxy-web"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="prometheus"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524693    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="config-reloader"
Jul 25 01:13:28.524876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.524700    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" containerName="thanos-sidecar"
Jul 25 01:13:28.528611 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.528586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.530872 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.530849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 25 01:13:28.530872 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.530863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 25 01:13:28.531037 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.530870    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 25 01:13:28.531092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49nd7cq1ag55i\""
Jul 25 01:13:28.531092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531053    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 25 01:13:28.531181 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531098    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.531877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.532044    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.532137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.532141    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 25 01:13:28.532302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.532291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 25 01:13:28.533239 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.533070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dzl9h\""
Jul 25 01:13:28.535715 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.535697    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.536077    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536110    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536137    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536274    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.536428    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536456    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.536544 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536478    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.536920 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.536734    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.536920 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536762    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.536920 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.536784    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.537178    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537200    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537217    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.537471    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537499    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.537639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537538    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.538007 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.537755    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.538007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537770    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.538007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.537782    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.538559 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:13:28.538334    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.538559 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.538362    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.538559 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.538386    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.538757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.538650    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.538757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.538675    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.539365 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.538986    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.539469 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.539372    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.539469 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.539386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 25 01:13:28.545026 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.544989    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.545244 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.545224    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.547148 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.547129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:28.547362 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.547332    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.547454 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.547366    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.548101 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.548072    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.548238 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.548206    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.548597 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.548570    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.548720 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.548706    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.549545 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.549500    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.549620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.549547    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.549864 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.549836    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.549958 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.549867    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.550138 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550120    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.550222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550141    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.550432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.550432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550429    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.550728 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550699    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.550728 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550725    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.550987 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550962    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.551062 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.550990    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.551297 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551273    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.551371 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551300    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.551586 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551558    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.551662 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551586    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.551888 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551860    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.551888 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.551887    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.552140 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552121    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.552220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552141    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.552395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552374    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.552466 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552397    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.552680 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552659    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.552680 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552679    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.552908 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552887    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.553002 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.552910    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.553160 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553137    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.553160 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553160    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.553493 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553468    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.553626 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553493    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.553791 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553769    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.553908 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.553792    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.554050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554027    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.554118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554052    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.554398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554380    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.554398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554396    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.554671 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554651    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.554671 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554671    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.554941 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554912    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.554941 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.554939    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.555184 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555156    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.555184 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555182    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.555466 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555443    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.555549 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555468    2565 scope.go:117] "RemoveContainer" containerID="e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"
Jul 25 01:13:28.555770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555738    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3"} err="failed to get container status \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": rpc error: code = NotFound desc = could not find container \"e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3\": container with ID starting with e878187392d743ec1b104b94b9b20fd8393720785972668215c30b7c33f163a3 not found: ID does not exist"
Jul 25 01:13:28.555770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555762    2565 scope.go:117] "RemoveContainer" containerID="e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"
Jul 25 01:13:28.556011 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.555994    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892"} err="failed to get container status \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": rpc error: code = NotFound desc = could not find container \"e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892\": container with ID starting with e73b3d269cb6773e5b5ceeebfb912bc2466ae2ec981f3fb0e0ea4917cb269892 not found: ID does not exist"
Jul 25 01:13:28.556011 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556011    2565 scope.go:117] "RemoveContainer" containerID="550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"
Jul 25 01:13:28.556251 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556232    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21"} err="failed to get container status \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": rpc error: code = NotFound desc = could not find container \"550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21\": container with ID starting with 550cc668aee16a57f405feb3555b5e31eaadb08c5bb10676340d2b0ebddeee21 not found: ID does not exist"
Jul 25 01:13:28.556311 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556252    2565 scope.go:117] "RemoveContainer" containerID="fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"
Jul 25 01:13:28.556539 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556497    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6"} err="failed to get container status \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": rpc error: code = NotFound desc = could not find container \"fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6\": container with ID starting with fe26ef18492efc41ced1bc2544d651001ee2a95911fa42a808648a0be85918f6 not found: ID does not exist"
Jul 25 01:13:28.556539 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556538    2565 scope.go:117] "RemoveContainer" containerID="9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"
Jul 25 01:13:28.556787 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556755    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae"} err="failed to get container status \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": rpc error: code = NotFound desc = could not find container \"9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae\": container with ID starting with 9b8ff2ca231118fdcdc7a6683a9b97e20f01c6d2b8e3427bad1dee0f364e8cae not found: ID does not exist"
Jul 25 01:13:28.556854 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.556788    2565 scope.go:117] "RemoveContainer" containerID="f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"
Jul 25 01:13:28.557086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.557066    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723"} err="failed to get container status \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": rpc error: code = NotFound desc = could not find container \"f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723\": container with ID starting with f13bc66a96c2891745815662a46a85b9576683f775863b5ad6da2448062c5723 not found: ID does not exist"
Jul 25 01:13:28.557086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.557085    2565 scope.go:117] "RemoveContainer" containerID="e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"
Jul 25 01:13:28.557323 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.557303    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1"} err="failed to get container status \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": rpc error: code = NotFound desc = could not find container \"e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1\": container with ID starting with e94aec7246770d35ca8e57f6f4bb86c998606f2ece1369dab5b8f89e77bac5b1 not found: ID does not exist"
Jul 25 01:13:28.601280 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601280 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601732 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601732 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601732 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.601999 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.601973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8ct\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-kube-api-access-rl8ct\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602318 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602469 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.602532 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.602499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.703897 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.703796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.703897 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.703851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704192 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704192 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704291 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8ct\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-kube-api-access-rl8ct\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704291 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704291 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704435 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.704655 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.704758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705316 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.705188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.705850 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.705539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.707220 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.707123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.708145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.707823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.708145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.708034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.709084 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.708415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5d4251c-649d-4d28-80d9-f9e10234374a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.709084 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.708454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.709084 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.708679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.709084 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.709021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.710981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.710992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711195 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.711034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711195 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.711126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711358 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.711318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711358 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.711328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5d4251c-649d-4d28-80d9-f9e10234374a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.711784 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.711755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5d4251c-649d-4d28-80d9-f9e10234374a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.716462 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.716438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8ct\" (UniqueName: \"kubernetes.io/projected/d5d4251c-649d-4d28-80d9-f9e10234374a-kube-api-access-rl8ct\") pod \"prometheus-k8s-0\" (UID: \"d5d4251c-649d-4d28-80d9-f9e10234374a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.845171 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.845125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:28.999347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:28.999314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 01:13:29.001391 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:13:29.001355    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d4251c_649d_4d28_80d9_f9e10234374a.slice/crio-6bdfa20a671e2711bc38ad1299110e805b222594e81097ce472264c620a4bd27 WatchSource:0}: Error finding container 6bdfa20a671e2711bc38ad1299110e805b222594e81097ce472264c620a4bd27: Status 404 returned error can't find the container with id 6bdfa20a671e2711bc38ad1299110e805b222594e81097ce472264c620a4bd27
Jul 25 01:13:29.477346 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:29.477305    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5d4251c-649d-4d28-80d9-f9e10234374a" containerID="fdd9f97d7e0bfe31a1e33c9b45f9febd31b80a12cd4d48a3f9627ddcd3d401bb" exitCode=0
Jul 25 01:13:29.477832 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:29.477349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerDied","Data":"fdd9f97d7e0bfe31a1e33c9b45f9febd31b80a12cd4d48a3f9627ddcd3d401bb"}
Jul 25 01:13:29.477832 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:29.477432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"6bdfa20a671e2711bc38ad1299110e805b222594e81097ce472264c620a4bd27"}
Jul 25 01:13:29.646440 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:29.646399    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c88d06e-eb54-4351-9b22-06fc9885bbd4" path="/var/lib/kubelet/pods/7c88d06e-eb54-4351-9b22-06fc9885bbd4/volumes"
Jul 25 01:13:30.484488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.484387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w" event={"ID":"27665c84-9499-49f7-ab0b-45f1f214702a","Type":"ContainerStarted","Data":"03775efc87be2e28745bab7186fdc8162af53672536440d7c3770bd7ce8a6075"}
Jul 25 01:13:30.484488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.484456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w" event={"ID":"27665c84-9499-49f7-ab0b-45f1f214702a","Type":"ContainerStarted","Data":"fac4a823166e9b44052e08faa79796633bcfe13707ac271f1e82ef6b28e56739"}
Jul 25 01:13:30.484488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.484482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w" event={"ID":"27665c84-9499-49f7-ab0b-45f1f214702a","Type":"ContainerStarted","Data":"d060195e163f25583ff72450aeb8e4baa6f061d8e51a423f597cd798dd6069c9"}
Jul 25 01:13:30.487894 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.487865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"9ebe7ee72e71d1a623044cbbb84e7c5c6d25cb9d731bfa1b746db5eb9439a1c4"}
Jul 25 01:13:30.488029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.487938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"98185fb7f58b1aa71a25e73273b8393bb81d34154adfd42eddfe686968ff7c34"}
Jul 25 01:13:30.488029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.487980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"ecd72c66e7caed5ee306e29d4a265c585923af4f0394451e859372b3a342c548"}
Jul 25 01:13:30.488029 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.488019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"9a9648a9f9a05049330229108d95c73dc568ade49ab85353b3a0d7a1bff84ac1"}
Jul 25 01:13:30.488120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.488059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"ed3f8dd7dde4ea7bebb46311630beaeeff0afac2c18bd78507c51e068c0b4c1d"}
Jul 25 01:13:30.488120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.488097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5d4251c-649d-4d28-80d9-f9e10234374a","Type":"ContainerStarted","Data":"9ea50463f60f1bb89a7de12bf6c969de11bd23d8b41ca1f5a123f885552a1394"}
Jul 25 01:13:30.504203 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.504137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b66d4556b-krm8w" podStartSLOduration=1.531112333 podStartE2EDuration="3.504114759s" totalImagesPullingTime="1.973002426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:30.502250415 +0000 UTC m=+129.404895426" watchObservedRunningTime="2026-07-25 01:13:30.504114759 +0000 UTC m=+129.406759772"
Jul 25 01:13:30.531898 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:30.531834    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.509744698 podStartE2EDuration="2.531808464s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.063766ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:30.530675415 +0000 UTC m=+129.433320436" watchObservedRunningTime="2026-07-25 01:13:30.531808464 +0000 UTC m=+129.434453475"
Jul 25 01:13:31.476219 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:31.476145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:31.531750 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:31.531712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:33.280931 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:33.280896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:33.846233 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:33.846176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:13:42.034399 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:42.034361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:42.093244 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:42.093201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:13:42.149343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:13:42.149308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:14:28.846240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:28.846203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:14:28.862396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:28.862365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:14:29.751452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:29.751426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 01:14:37.517468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:37.517429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:14:37.616824 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:37.616789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:14:41.696802 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:41.696762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:14:49.465290 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:49.465247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:14:49.515665 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:14:49.515630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:00.050865 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:00.050825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:00.151850 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:00.151815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:06.978615 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:06.978579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:07.035689 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:07.035653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:07.112568 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:07.112533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:07.213372 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:07.213340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:07.708552 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:07.708492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:18.374200 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:18.374160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:20.039060 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:20.039022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:27.985051 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:27.985013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:28.082772 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:28.082731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:36.934056 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:36.934017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:49.593621 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:49.593537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:50.399557 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:50.399526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:52.994011 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:52.993977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:53.095618 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:53.095584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:57.582776 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:57.582736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:15:57.632257 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:15:57.632211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:03.425093 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.425050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:03.500424 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.500384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:03.605305 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.605271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbzrc"]
Jul 25 01:16:03.608699 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.608681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.610324 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.610304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 25 01:16:03.610731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.610707    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 25 01:16:03.610851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.610711    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rdxc5\""
Jul 25 01:16:03.618334 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.618277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbzrc"]
Jul 25 01:16:03.706065 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.705965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj9m5\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-kube-api-access-fj9m5\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.706065 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.706019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.755268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.755231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:03.807343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.807301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj9m5\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-kube-api-access-fj9m5\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.807570 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.807375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.826492 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.826461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.829662 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.829638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj9m5\" (UniqueName: \"kubernetes.io/projected/aa7f78b8-9f94-4725-a6e3-60cde5b51ad0-kube-api-access-fj9m5\") pod \"cert-manager-webhook-6486ffd997-gbzrc\" (UID: \"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:03.871519 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.871469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:03.928669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:03.928618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:04.069121 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:04.069082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gbzrc"]
Jul 25 01:16:04.072378 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:16:04.072337    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa7f78b8_9f94_4725_a6e3_60cde5b51ad0.slice/crio-38fe7bb991b93f389a1956d06e24ee66e9521d5b06dbaed14330a89209f891b5 WatchSource:0}: Error finding container 38fe7bb991b93f389a1956d06e24ee66e9521d5b06dbaed14330a89209f891b5: Status 404 returned error can't find the container with id 38fe7bb991b93f389a1956d06e24ee66e9521d5b06dbaed14330a89209f891b5
Jul 25 01:16:04.122421 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:04.122385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc" event={"ID":"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0","Type":"ContainerStarted","Data":"38fe7bb991b93f389a1956d06e24ee66e9521d5b06dbaed14330a89209f891b5"}
Jul 25 01:16:05.464620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:05.464574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:05.888770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:05.888729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:06.448211 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.447632    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"]
Jul 25 01:16:06.458154 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.458124    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.458930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.458901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"]
Jul 25 01:16:06.460171 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.460039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6mchn\""
Jul 25 01:16:06.534422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.534341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.534422 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.534408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqf7p\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-kube-api-access-xqf7p\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.635557 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.635489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.635752 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.635592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf7p\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-kube-api-access-xqf7p\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.644113 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.644052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqf7p\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-kube-api-access-xqf7p\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.644113 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.644072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff67063-9970-4255-ac78-3944ab99386b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rlqxq\" (UID: \"7ff67063-9970-4255-ac78-3944ab99386b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:06.772082 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:06.771995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"
Jul 25 01:16:07.755469 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:07.755441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq"]
Jul 25 01:16:07.758861 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:16:07.758834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ff67063_9970_4255_ac78_3944ab99386b.slice/crio-f925fbde4751216a767389d827fb8c818856109ac7d40d4a3986720fadbcea72 WatchSource:0}: Error finding container f925fbde4751216a767389d827fb8c818856109ac7d40d4a3986720fadbcea72: Status 404 returned error can't find the container with id f925fbde4751216a767389d827fb8c818856109ac7d40d4a3986720fadbcea72
Jul 25 01:16:08.141786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.141749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq" event={"ID":"7ff67063-9970-4255-ac78-3944ab99386b","Type":"ContainerStarted","Data":"29599ba84f677b5740486a3980f6e2c0ce3ebe63e420a9b962b84c053d22e725"}
Jul 25 01:16:08.142051 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.141799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq" event={"ID":"7ff67063-9970-4255-ac78-3944ab99386b","Type":"ContainerStarted","Data":"f925fbde4751216a767389d827fb8c818856109ac7d40d4a3986720fadbcea72"}
Jul 25 01:16:08.143354 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.143331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc" event={"ID":"aa7f78b8-9f94-4725-a6e3-60cde5b51ad0","Type":"ContainerStarted","Data":"e7d4f96dd87fa5fe369c8c31ef001da630cb9cf9d647a90908f25ea015d1cbac"}
Jul 25 01:16:08.143473 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.143392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:08.158731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.158682    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rlqxq" podStartSLOduration=2.158663749 podStartE2EDuration="2.158663749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:16:08.157415198 +0000 UTC m=+287.060060210" watchObservedRunningTime="2026-07-25 01:16:08.158663749 +0000 UTC m=+287.061308759"
Jul 25 01:16:08.171674 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:08.171623    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc" podStartSLOduration=1.5605065009999999 podStartE2EDuration="5.17160408s" totalImagesPullingTime="3.611097579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:16:08.17041218 +0000 UTC m=+287.073057192" watchObservedRunningTime="2026-07-25 01:16:08.17160408 +0000 UTC m=+287.074249091"
Jul 25 01:16:14.150098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:14.150068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gbzrc"
Jul 25 01:16:14.228678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:14.228642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:16.271756 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:16.271719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:16.369086 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:16.369049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:21.249827 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:21.249795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:21.344471 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:21.344430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:21.523001 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:21.522919    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 25 01:16:23.442589 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:23.442550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:35.297784 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:35.297749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:35.407583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:35.407546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:39.868912 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:39.868817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:39.961892 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:39.961848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:40.437947 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.437914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:40.684303 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.684260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:40.784748 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.784654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:40.836189 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.836155    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"]
Jul 25 01:16:40.872083 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.872051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"]
Jul 25 01:16:40.872519 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.872190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:40.874066 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.874039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 25 01:16:40.874382 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.874345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrsw7\""
Jul 25 01:16:40.874382 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.874369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 25 01:16:40.874585 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.874403    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 25 01:16:40.874585 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.874349    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 25 01:16:40.977298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:40.977262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:41.043062 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.042977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-manifests\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.043062 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.043026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.043248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.043161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bthm\" (UniqueName: \"kubernetes.io/projected/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-kube-api-access-4bthm\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.043248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.043184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-tmp\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.043248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.043216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.074290 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.074248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:41.144367 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.144367 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-manifests\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.144651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.144651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bthm\" (UniqueName: \"kubernetes.io/projected/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-kube-api-access-4bthm\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.144651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-tmp\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.144850 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.144805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-manifests\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.146821 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.146791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-tmp\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.146976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.146958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.147057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.147007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.151666 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.151644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bthm\" (UniqueName: \"kubernetes.io/projected/8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb-kube-api-access-4bthm\") pod \"opendatahub-operator-controller-manager-9844cf678-qvbnc\" (UID: \"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb\") " pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.174798 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.174767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:41.182641 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.182612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:41.274152 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.274068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:41.339766 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.339731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:41.368586 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.368553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"]
Jul 25 01:16:41.372327 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:16:41.372301    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bedb8e9_5318_4f7f_ac9f_9c49f396d2cb.slice/crio-9fc5513ee0f3d39b6e541c26285be6df3174223ae938fbc9f4206f9ac32d619c WatchSource:0}: Error finding container 9fc5513ee0f3d39b6e541c26285be6df3174223ae938fbc9f4206f9ac32d619c: Status 404 returned error can't find the container with id 9fc5513ee0f3d39b6e541c26285be6df3174223ae938fbc9f4206f9ac32d619c
Jul 25 01:16:41.374777 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:41.374760    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:16:42.292996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:42.292958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc" event={"ID":"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb","Type":"ContainerStarted","Data":"9fc5513ee0f3d39b6e541c26285be6df3174223ae938fbc9f4206f9ac32d619c"}
Jul 25 01:16:45.309245 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:45.309207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc" event={"ID":"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb","Type":"ContainerStarted","Data":"fbd6cca88ad04931e754bbcb788819366e7701f092ca93fb2c8cb0e09dfae849"}
Jul 25 01:16:46.314893 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:46.314858    2565 generic.go:356] "Generic (PLEG): container finished" podID="8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb" containerID="fbd6cca88ad04931e754bbcb788819366e7701f092ca93fb2c8cb0e09dfae849" exitCode=0
Jul 25 01:16:46.315358 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:46.314910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc" event={"ID":"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb","Type":"ContainerDied","Data":"fbd6cca88ad04931e754bbcb788819366e7701f092ca93fb2c8cb0e09dfae849"}
Jul 25 01:16:47.322938 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:47.322837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc" event={"ID":"8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb","Type":"ContainerStarted","Data":"046e427d86f8996092e198c14709a0884c6f1bc76646e03dde2259e80f69d00c"}
Jul 25 01:16:47.323297 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:47.322935    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:47.341745 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:47.341690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc" podStartSLOduration=2.642334273 podStartE2EDuration="7.341670934s" totalImagesPullingTime="3.65596793s" totalInitContainerRuntime="1.043368731s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:16:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:16:47.340192122 +0000 UTC m=+326.242837175" watchObservedRunningTime="2026-07-25 01:16:47.341670934 +0000 UTC m=+326.244315946"
Jul 25 01:16:47.666498 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:47.666463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:47.765013 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:47.764980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:52.387572 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:52.387539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:52.489197 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:52.489153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:16:58.332404 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:58.332377    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9844cf678-qvbnc"
Jul 25 01:16:59.976884 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:16:59.976843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.082724 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.082673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.329832 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.329799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.634883 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.634805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.735008 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.734969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.835535 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.835476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:00.938937 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:00.938836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:01.330917 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:01.330886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:01.556731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:01.556691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:01.650579 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:01.650473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:01.709573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:01.709537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:02.708395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:02.708350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:06.439844 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.439810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:06.538596 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.538556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:06.702355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.702272    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"]
Jul 25 01:17:06.708325 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.708295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.710605 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.710536    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 25 01:17:06.710880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.710850    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lfs94\""
Jul 25 01:17:06.710982 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.710961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 25 01:17:06.711058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.711033    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:17:06.711213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.711191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 25 01:17:06.711351 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.711288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 25 01:17:06.715303 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.715279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"]
Jul 25 01:17:06.779981 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.779946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-metrics-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.780175 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.779998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.780175 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.780105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kkmw\" (UniqueName: \"kubernetes.io/projected/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-kube-api-access-8kkmw\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.780175 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.780162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-manager-config\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.880803 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.880762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kkmw\" (UniqueName: \"kubernetes.io/projected/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-kube-api-access-8kkmw\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.880992 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.880816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-manager-config\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.880992 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.880853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-metrics-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.880992 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.880886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.881765 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.881738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-manager-config\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.883758 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.883732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-metrics-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.883862 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.883841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-cert\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:06.889017 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:06.888962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kkmw\" (UniqueName: \"kubernetes.io/projected/7fdc2afc-790e-4ca4-8c13-a90a81d277d5-kube-api-access-8kkmw\") pod \"lws-controller-manager-66889bf7cd-cw9k8\" (UID: \"7fdc2afc-790e-4ca4-8c13-a90a81d277d5\") " pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:07.012232 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.012149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"]
Jul 25 01:17:07.015103 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.015083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.017234 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.017188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 25 01:17:07.017391 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.017345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p9b52\""
Jul 25 01:17:07.017453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.017425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 25 01:17:07.017616 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.017601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 25 01:17:07.020548 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.020525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:07.028388 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.028343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"]
Jul 25 01:17:07.046177 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.046121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:07.082576 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082576 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082927 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxpgh\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-kube-api-access-gxpgh\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.082927 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.082824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.177249 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.177221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"]
Jul 25 01:17:07.179696 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:17:07.179662    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdc2afc_790e_4ca4_8c13_a90a81d277d5.slice/crio-87621b0adb098fc36d3deb9d7eee9e4e997dd3ac4dc237bf25777fc479a3d91c WatchSource:0}: Error finding container 87621b0adb098fc36d3deb9d7eee9e4e997dd3ac4dc237bf25777fc479a3d91c: Status 404 returned error can't find the container with id 87621b0adb098fc36d3deb9d7eee9e4e997dd3ac4dc237bf25777fc479a3d91c
Jul 25 01:17:07.183352 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183682 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxpgh\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-kube-api-access-gxpgh\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183789 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.183789 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.184145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.183895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.184145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.184029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.184145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.184093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.184332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.184309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.186482 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.186459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.186842 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.186824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.190556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.190535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.190735 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.190717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxpgh\" (UniqueName: \"kubernetes.io/projected/e11fcafe-d3c9-4c60-8a23-74bb6eb23a29-kube-api-access-gxpgh\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv\" (UID: \"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.328362 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.328266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:07.329872 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.329846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:07.419689 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.419650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8" event={"ID":"7fdc2afc-790e-4ca4-8c13-a90a81d277d5","Type":"ContainerStarted","Data":"87621b0adb098fc36d3deb9d7eee9e4e997dd3ac4dc237bf25777fc479a3d91c"}
Jul 25 01:17:07.432065 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.431890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:07.486569 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:07.486536    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"]
Jul 25 01:17:07.489572 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:17:07.489535    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11fcafe_d3c9_4c60_8a23_74bb6eb23a29.slice/crio-9250b900f4a58e6fb5e939e9f27109d8524e7023475fdd23ad012c07aec53fdb WatchSource:0}: Error finding container 9250b900f4a58e6fb5e939e9f27109d8524e7023475fdd23ad012c07aec53fdb: Status 404 returned error can't find the container with id 9250b900f4a58e6fb5e939e9f27109d8524e7023475fdd23ad012c07aec53fdb
Jul 25 01:17:08.430468 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.430416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv" event={"ID":"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29","Type":"ContainerStarted","Data":"9250b900f4a58e6fb5e939e9f27109d8524e7023475fdd23ad012c07aec53fdb"}
Jul 25 01:17:08.889118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.889082    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"]
Jul 25 01:17:08.892305 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.892282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:08.894289 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.894260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 25 01:17:08.894458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.894399    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qkm6g\""
Jul 25 01:17:08.894458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.894260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 25 01:17:08.894598 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.894584    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 25 01:17:08.906160 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:08.906087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"]
Jul 25 01:17:09.003691 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.003691 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.003943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.003943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvtwp\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-kube-api-access-zvtwp\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.003943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.003943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6968c23f-97df-43b0-a9c2-1953b2bd9461-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.004157 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.003959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105158 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105158 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6968c23f-97df-43b0-a9c2-1953b2bd9461-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105427 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.105642 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.105432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvtwp\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-kube-api-access-zvtwp\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.107139 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.106487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.109622 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.109355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.109622 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.109583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.110151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.110121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6968c23f-97df-43b0-a9c2-1953b2bd9461-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.110800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.110777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.123347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.123313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvtwp\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-kube-api-access-zvtwp\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.125404 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.125341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6968c23f-97df-43b0-a9c2-1953b2bd9461-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mc62z\" (UID: \"6968c23f-97df-43b0-a9c2-1953b2bd9461\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.206797 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.206709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:09.971742 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:09.971705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"]
Jul 25 01:17:09.976978 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:17:09.976936    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6968c23f_97df_43b0_a9c2_1953b2bd9461.slice/crio-c8626d7e21718bd4cbbcafbda1d976728a593bd565ccf2c718d272f05626a433 WatchSource:0}: Error finding container c8626d7e21718bd4cbbcafbda1d976728a593bd565ccf2c718d272f05626a433: Status 404 returned error can't find the container with id c8626d7e21718bd4cbbcafbda1d976728a593bd565ccf2c718d272f05626a433
Jul 25 01:17:10.442450 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:10.442415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z" event={"ID":"6968c23f-97df-43b0-a9c2-1953b2bd9461","Type":"ContainerStarted","Data":"c8626d7e21718bd4cbbcafbda1d976728a593bd565ccf2c718d272f05626a433"}
Jul 25 01:17:10.444202 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:10.444163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8" event={"ID":"7fdc2afc-790e-4ca4-8c13-a90a81d277d5","Type":"ContainerStarted","Data":"7639547cdc105dbbb4e09b26167cbd97ac0c020777a6133ac2f3afe3241476e9"}
Jul 25 01:17:10.444370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:10.444290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:10.460837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:10.460779    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8" podStartSLOduration=1.8730453040000001 podStartE2EDuration="4.460758916s" totalImagesPullingTime="2.587713612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:10.459922915 +0000 UTC m=+349.362567949" watchObservedRunningTime="2026-07-25 01:17:10.460758916 +0000 UTC m=+349.363403927"
Jul 25 01:17:11.301043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:11.300967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:11.385739 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:11.385695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:11.461268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:11.461225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:11.594996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:11.594960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:12.536208 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.536165    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:12.536573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.536239    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:12.536573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.536253    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:12.536573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.536311    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:12.536573 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.536377    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:12.579462 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.579427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:12.680954 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.680831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:12.800919 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:12.800813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:13.469592 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.469548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv" event={"ID":"e11fcafe-d3c9-4c60-8a23-74bb6eb23a29","Type":"ContainerStarted","Data":"ef227c5fdf2a73fca1ec675582b5eec44ba619700da3f2285068f537079f9205"}
Jul 25 01:17:13.471129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.471103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z" event={"ID":"6968c23f-97df-43b0-a9c2-1953b2bd9461","Type":"ContainerStarted","Data":"42e6c9ee56c50a1a27e14194991eafaad477c46fe5b42e8c0d07fefd3814e6f6"}
Jul 25 01:17:13.471273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.471261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:13.472928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.472899    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z"
Jul 25 01:17:13.489463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.489407    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv" podStartSLOduration=2.445145526 podStartE2EDuration="7.489389187s" totalImagesPullingTime="5.044243661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:13.487782062 +0000 UTC m=+352.390427095" watchObservedRunningTime="2026-07-25 01:17:13.489389187 +0000 UTC m=+352.392034198"
Jul 25 01:17:13.507986 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:13.507934    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mc62z" podStartSLOduration=2.951475241 podStartE2EDuration="5.507917135s" totalImagesPullingTime="2.556441894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:13.506123446 +0000 UTC m=+352.408768460" watchObservedRunningTime="2026-07-25 01:17:13.507917135 +0000 UTC m=+352.410562145"
Jul 25 01:17:14.328724 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:14.328686    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:14.334309 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:14.334281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:14.475680 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:14.475649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:14.476670 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:14.476650    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv"
Jul 25 01:17:21.459298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:21.459265    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66889bf7cd-cw9k8"
Jul 25 01:17:44.313609 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:44.313547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:17:44.368140 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:17:44.368099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:01.322068 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:01.322027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:01.441969 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:01.441923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:01.541115 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:01.541070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:02.227625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:02.227586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:02.435319 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:02.435288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:22.327873 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:22.327837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:27.188690 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:27.188646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:28.185050 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:28.185011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:32.449197 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:32.449155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:34.191537 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:34.191470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:36.797903 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:36.797864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:36.892952 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:36.892909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:37.246767 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:37.246730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:37.366786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:37.366750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:37.598525 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:37.598474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:38.871937 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:38.871906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:38.923766 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:38.923705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:39.025284 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:39.025228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:39.125632 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:39.125536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:39.410584 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:39.410482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:39.622765 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:39.622732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:41.390771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:41.390736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:41.492697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:41.492654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:43.652092 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:43.651989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:48.393151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:48.393106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:48.493321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:48.493265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:49.588263 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:49.588201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:49.639393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:49.639343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:50.261909 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:50.261873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:50.316192 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:50.316154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:50.380025 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:50.379995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:54.188246 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:54.188199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:54.288809 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:54.288766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:55.770949 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:55.770915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:56.050814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:56.050693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:58.397048 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:58.396993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:18:58.497300 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:18:58.497258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:02.799229 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:02.799186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:02.918771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:02.918737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:05.372929 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.372886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"]
Jul 25 01:19:05.376129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.376104    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.379673 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.379647    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 25 01:19:05.379827 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.379648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 25 01:19:05.379827 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.379648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxtfb\""
Jul 25 01:19:05.388935 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.388908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"]
Jul 25 01:19:05.425848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.425806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.425848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.425841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6gc\" (UniqueName: \"kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.526704 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.526644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.526704 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.526711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6gc\" (UniqueName: \"kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.527058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.527027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.534524 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.534484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6gc\" (UniqueName: \"kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.688376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.688278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:05.830940 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:05.830898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"]
Jul 25 01:19:05.836760 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:19:05.836732    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7eefeb_c078_4899_9bca_7a3f27e97bb3.slice/crio-98ca24cadafd2fa07e07fce65348bafcb139d51d280622525fa6d6bc303c075c WatchSource:0}: Error finding container 98ca24cadafd2fa07e07fce65348bafcb139d51d280622525fa6d6bc303c075c: Status 404 returned error can't find the container with id 98ca24cadafd2fa07e07fce65348bafcb139d51d280622525fa6d6bc303c075c
Jul 25 01:19:06.014532 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:06.014418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj" event={"ID":"bc7eefeb-c078-4899-9bca-7a3f27e97bb3","Type":"ContainerStarted","Data":"98ca24cadafd2fa07e07fce65348bafcb139d51d280622525fa6d6bc303c075c"}
Jul 25 01:19:06.070480 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:06.070442    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"]
Jul 25 01:19:06.074617 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:06.074580    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"]
Jul 25 01:19:09.602284 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:09.602249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:09.653348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:09.653307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:09.999395 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:09.999310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:10.050881 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:10.050845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:11.046502 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.046443    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" containerName="manager" containerID="cri-o://df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779" gracePeriod=2
Jul 25 01:19:11.294648 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.294620    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:11.296260 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:19:11.296234    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" is forbidden: User \"system:node:ip-10-0-130-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-23.ec2.internal' and this object" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:11.395946 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.395910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume\") pod \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") "
Jul 25 01:19:11.396176 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.395977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh6gc\" (UniqueName: \"kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc\") pod \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\" (UID: \"bc7eefeb-c078-4899-9bca-7a3f27e97bb3\") "
Jul 25 01:19:11.396245 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.396221    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc7eefeb-c078-4899-9bca-7a3f27e97bb3" (UID: "bc7eefeb-c078-4899-9bca-7a3f27e97bb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:19:11.398248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.398209    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc" (OuterVolumeSpecName: "kube-api-access-mh6gc") pod "bc7eefeb-c078-4899-9bca-7a3f27e97bb3" (UID: "bc7eefeb-c078-4899-9bca-7a3f27e97bb3"). InnerVolumeSpecName "kube-api-access-mh6gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:19:11.497310 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.497262    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-extensions-socket-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:19:11.497310 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.497300    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh6gc\" (UniqueName: \"kubernetes.io/projected/bc7eefeb-c078-4899-9bca-7a3f27e97bb3-kube-api-access-mh6gc\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:19:11.643049 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:19:11.643013    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" is forbidden: User \"system:node:ip-10-0-130-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-23.ec2.internal' and this object" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:11.645584 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:11.645559    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" path="/var/lib/kubelet/pods/bc7eefeb-c078-4899-9bca-7a3f27e97bb3/volumes"
Jul 25 01:19:12.052587 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:12.052461    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" containerID="df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779" exitCode=2
Jul 25 01:19:12.052587 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:12.052537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:12.052587 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:12.052568    2565 scope.go:117] "RemoveContainer" containerID="df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779"
Jul 25 01:19:12.056343 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:19:12.056310    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4wbnj\" is forbidden: User \"system:node:ip-10-0-130-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-23.ec2.internal' and this object" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4wbnj"
Jul 25 01:19:12.061383 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:12.061366    2565 scope.go:117] "RemoveContainer" containerID="df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779"
Jul 25 01:19:12.061686 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:19:12.061665    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779\": container with ID starting with df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779 not found: ID does not exist" containerID="df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779"
Jul 25 01:19:12.061737 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:12.061696    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779"} err="failed to get container status \"df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779\": rpc error: code = NotFound desc = could not find container \"df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779\": container with ID starting with df3f36da6c5b6b833b562dde455171cfadfc8e9b33f3fc46056753f6e94de779 not found: ID does not exist"
Jul 25 01:19:13.600882 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:13.600845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:13.702500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:13.702467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:16.197262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:16.197215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:16.255627 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:16.255594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:20.433781 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:20.433739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:20.534452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:20.534416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:21.623463 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:21.623426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:21.723461 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:21.723427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:45.859075 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:45.859034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:46.885462 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.885427    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"]
Jul 25 01:19:46.886011 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.885994    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" containerName="manager"
Jul 25 01:19:46.886056 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.886015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" containerName="manager"
Jul 25 01:19:46.886135 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.886123    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7eefeb-c078-4899-9bca-7a3f27e97bb3" containerName="manager"
Jul 25 01:19:46.888334 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.888311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:46.890404 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.890380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9mm7c\""
Jul 25 01:19:46.898388 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.898352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"]
Jul 25 01:19:46.909825 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:46.909787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:47.009711 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.009679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:19:47.027065 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027261 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027261 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027261 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad96367b-ec55-4b0a-86cc-587672b0545d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027261 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027261 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfbt\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-kube-api-access-5qfbt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027436 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027436 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.027436 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.027339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128442 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128700 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128700 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128700 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad96367b-ec55-4b0a-86cc-587672b0545d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfbt\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-kube-api-access-5qfbt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.128973 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.128916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129302 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129400 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.129561 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.129494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad96367b-ec55-4b0a-86cc-587672b0545d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.131455 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.131429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.131864 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.131841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.137370 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.137302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.137718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.137697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfbt\" (UniqueName: \"kubernetes.io/projected/ad96367b-ec55-4b0a-86cc-587672b0545d-kube-api-access-5qfbt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s7c86\" (UID: \"ad96367b-ec55-4b0a-86cc-587672b0545d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.200694 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.200654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:47.353762 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.353727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"]
Jul 25 01:19:47.357238 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:19:47.357198    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad96367b_ec55_4b0a_86cc_587672b0545d.slice/crio-cfa954c23576b1cf8875366cb9d0b7534936a42fb61429435138e360d33f2f7a WatchSource:0}: Error finding container cfa954c23576b1cf8875366cb9d0b7534936a42fb61429435138e360d33f2f7a: Status 404 returned error can't find the container with id cfa954c23576b1cf8875366cb9d0b7534936a42fb61429435138e360d33f2f7a
Jul 25 01:19:47.359941 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.359909    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:19:47.360022 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.359976    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:19:47.360022 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:47.360006    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:19:48.227752 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:48.227718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" event={"ID":"ad96367b-ec55-4b0a-86cc-587672b0545d","Type":"ContainerStarted","Data":"a63af827fc2d980e348d80ca75a6b4368a50a09c2b0c8c67fa52538e3e689270"}
Jul 25 01:19:48.228141 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:48.227802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" event={"ID":"ad96367b-ec55-4b0a-86cc-587672b0545d","Type":"ContainerStarted","Data":"cfa954c23576b1cf8875366cb9d0b7534936a42fb61429435138e360d33f2f7a"}
Jul 25 01:19:48.246049 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:48.245977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" podStartSLOduration=2.24595591 podStartE2EDuration="2.24595591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:19:48.245150707 +0000 UTC m=+507.147795718" watchObservedRunningTime="2026-07-25 01:19:48.24595591 +0000 UTC m=+507.148600926"
Jul 25 01:19:49.201199 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:49.201160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:49.206213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:49.206185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:49.234034 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:49.233999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:19:49.234992 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:19:49.234969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:20:04.174102 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:04.174068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:04.280730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:04.280695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:04.333032 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:04.332994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:05.016151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:05.016115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:05.117656 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:05.117617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:13.813461 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:13.813364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:25.858278 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:25.858244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:27.215021 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:27.214978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:38.296119 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:38.296076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:38.480803 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:38.480765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:45.372550 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.372498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:45.391997 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.391954    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:20:45.395686 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.395657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.397830 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.397798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 25 01:20:45.397969 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.397851    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 25 01:20:45.397969 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.397856    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m2pdl\""
Jul 25 01:20:45.406265 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.406239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:20:45.466937 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.466890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:45.495857 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.495824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crp8t\" (UniqueName: \"kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.496057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.495886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.567588 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.567553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:45.574989 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.574962    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:20:45.578595 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.578573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.585622 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.585595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:20:45.597113 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.597085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crp8t\" (UniqueName: \"kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.597275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.597136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.597275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.597160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9lf7\" (UniqueName: \"kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.597275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.597183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.599837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.599815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.603786 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.603766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crp8t\" (UniqueName: \"kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t\") pod \"maas-controller-5f88fc7559-h728k\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") " pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.698241 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.698123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.698241 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.698189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9lf7\" (UniqueName: \"kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.700503 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.700477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.706015 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.705985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9lf7\" (UniqueName: \"kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7\") pod \"maas-controller-cd5dc4b6d-5272r\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") " pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:45.707921 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.707897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:45.846534 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.846327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:20:45.849318 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:20:45.849282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b71c48c_5dbb_4c6c_9a2d_eb6b13b08031.slice/crio-84111fa6213505e509a6a406e207a1de5dc1a7d69d4cfba2a5df4432c27f77ce WatchSource:0}: Error finding container 84111fa6213505e509a6a406e207a1de5dc1a7d69d4cfba2a5df4432c27f77ce: Status 404 returned error can't find the container with id 84111fa6213505e509a6a406e207a1de5dc1a7d69d4cfba2a5df4432c27f77ce
Jul 25 01:20:45.891173 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:45.891115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:46.026836 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:46.026811    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:20:46.029439 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:20:46.029412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be3415d_8403_4049_8c7d_b2bacd03c894.slice/crio-b807db762db8d6b341a6e1cf39560e7e976c5c5b41e6203821c3f959c7adb1c4 WatchSource:0}: Error finding container b807db762db8d6b341a6e1cf39560e7e976c5c5b41e6203821c3f959c7adb1c4: Status 404 returned error can't find the container with id b807db762db8d6b341a6e1cf39560e7e976c5c5b41e6203821c3f959c7adb1c4
Jul 25 01:20:46.509588 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:46.509444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f88fc7559-h728k" event={"ID":"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031","Type":"ContainerStarted","Data":"84111fa6213505e509a6a406e207a1de5dc1a7d69d4cfba2a5df4432c27f77ce"}
Jul 25 01:20:46.511992 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:46.511869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" event={"ID":"1be3415d-8403-4049-8c7d-b2bacd03c894","Type":"ContainerStarted","Data":"b807db762db8d6b341a6e1cf39560e7e976c5c5b41e6203821c3f959c7adb1c4"}
Jul 25 01:20:48.664644 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:48.664603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:48.758857 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:48.758763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:20:49.530925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.530885    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f88fc7559-h728k" event={"ID":"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031","Type":"ContainerStarted","Data":"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"}
Jul 25 01:20:49.531162 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.531113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:20:49.532589 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.532561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" event={"ID":"1be3415d-8403-4049-8c7d-b2bacd03c894","Type":"ContainerStarted","Data":"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"}
Jul 25 01:20:49.532743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.532699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:20:49.546841 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.546787    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f88fc7559-h728k" podStartSLOduration=1.912599304 podStartE2EDuration="4.546770955s" totalImagesPullingTime="2.634171651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:20:49.545112254 +0000 UTC m=+568.447757267" watchObservedRunningTime="2026-07-25 01:20:49.546770955 +0000 UTC m=+568.449415965"
Jul 25 01:20:49.560100 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:20:49.560042    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" podStartSLOduration=2.098895717 podStartE2EDuration="4.560023851s" totalImagesPullingTime="2.461128134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:20:49.558614935 +0000 UTC m=+568.461259946" watchObservedRunningTime="2026-07-25 01:20:49.560023851 +0000 UTC m=+568.462668892"
Jul 25 01:21:00.540158 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.540125    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:21:00.540668 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.540197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:21:00.596949 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.596906    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:21:00.597295 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.597231    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f88fc7559-h728k" podUID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" containerName="manager" containerID="cri-o://2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b" gracePeriod=30
Jul 25 01:21:00.851913 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.851885    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:21:00.947203 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.947156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert\") pod \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") "
Jul 25 01:21:00.947390 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.947239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crp8t\" (UniqueName: \"kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t\") pod \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\" (UID: \"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031\") "
Jul 25 01:21:00.949619 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.949587    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" (UID: "0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:21:00.949706 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:00.949616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t" (OuterVolumeSpecName: "kube-api-access-crp8t") pod "0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" (UID: "0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031"). InnerVolumeSpecName "kube-api-access-crp8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:21:01.048262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.048221    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-webhook-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:21:01.048262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.048258    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crp8t\" (UniqueName: \"kubernetes.io/projected/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031-kube-api-access-crp8t\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:21:01.592778 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.592742    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" containerID="2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b" exitCode=0
Jul 25 01:21:01.593314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.592789    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f88fc7559-h728k"
Jul 25 01:21:01.593314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.592832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f88fc7559-h728k" event={"ID":"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031","Type":"ContainerDied","Data":"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"}
Jul 25 01:21:01.593314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.592895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f88fc7559-h728k" event={"ID":"0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031","Type":"ContainerDied","Data":"84111fa6213505e509a6a406e207a1de5dc1a7d69d4cfba2a5df4432c27f77ce"}
Jul 25 01:21:01.593314 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.592934    2565 scope.go:117] "RemoveContainer" containerID="2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"
Jul 25 01:21:01.602194 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.602034    2565 scope.go:117] "RemoveContainer" containerID="2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"
Jul 25 01:21:01.602358 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:21:01.602339    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b\": container with ID starting with 2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b not found: ID does not exist" containerID="2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"
Jul 25 01:21:01.602396 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.602371    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b"} err="failed to get container status \"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b\": rpc error: code = NotFound desc = could not find container \"2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b\": container with ID starting with 2380b8ba188ad939b74cacbca34aefe8ad9eddc13cfbb6eeb435bdcb41b4022b not found: ID does not exist"
Jul 25 01:21:01.613099 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.613071    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:21:01.616670 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.616646    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f88fc7559-h728k"]
Jul 25 01:21:01.645742 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:01.645708    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" path="/var/lib/kubelet/pods/0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031/volumes"
Jul 25 01:21:20.481651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:20.481612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:20.609827 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:20.609786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:20.978325 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:20.978294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:21.336354 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.336313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:21.504960 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.504923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:21.605398 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.605289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:21.705912 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.705871    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"]
Jul 25 01:21:21.706815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.706435    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" containerName="manager"
Jul 25 01:21:21.706815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.706458    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" containerName="manager"
Jul 25 01:21:21.706815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.706574    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b71c48c-5dbb-4c6c-9a2d-eb6b13b08031" containerName="manager"
Jul 25 01:21:21.714781 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.714755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.717790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.717763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fvht6\""
Jul 25 01:21:21.718093 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.718051    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 25 01:21:21.720455 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.720419    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"]
Jul 25 01:21:21.751793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.751751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5p7h\" (UniqueName: \"kubernetes.io/projected/61ee4fde-e70b-4448-85c3-0492b6c382cb-kube-api-access-j5p7h\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.751988 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.751804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ee4fde-e70b-4448-85c3-0492b6c382cb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.853359 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.853325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5p7h\" (UniqueName: \"kubernetes.io/projected/61ee4fde-e70b-4448-85c3-0492b6c382cb-kube-api-access-j5p7h\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.853555 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.853366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ee4fde-e70b-4448-85c3-0492b6c382cb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.854133 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.854113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ee4fde-e70b-4448-85c3-0492b6c382cb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:21.860344 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:21.860274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5p7h\" (UniqueName: \"kubernetes.io/projected/61ee4fde-e70b-4448-85c3-0492b6c382cb-kube-api-access-j5p7h\") pod \"payload-pre-processing-687dbb6cf6-79szl\" (UID: \"61ee4fde-e70b-4448-85c3-0492b6c382cb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:22.029456 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:22.029417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:22.180355 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:22.180325    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"]
Jul 25 01:21:22.183840 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:21:22.183814    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ee4fde_e70b_4448_85c3_0492b6c382cb.slice/crio-54c9cb1d8167819242b92d53fdd4e415c2e07def1374d0aedce3e69632fbc51f WatchSource:0}: Error finding container 54c9cb1d8167819242b92d53fdd4e415c2e07def1374d0aedce3e69632fbc51f: Status 404 returned error can't find the container with id 54c9cb1d8167819242b92d53fdd4e415c2e07def1374d0aedce3e69632fbc51f
Jul 25 01:21:22.702432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:22.702396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl" event={"ID":"61ee4fde-e70b-4448-85c3-0492b6c382cb","Type":"ContainerStarted","Data":"54c9cb1d8167819242b92d53fdd4e415c2e07def1374d0aedce3e69632fbc51f"}
Jul 25 01:21:24.718098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:24.718058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl" event={"ID":"61ee4fde-e70b-4448-85c3-0492b6c382cb","Type":"ContainerStarted","Data":"3bfeba88758719578461df103af1f3d879cf34105ad48f4dc382ecc9d5dfe0bb"}
Jul 25 01:21:24.718571 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:24.718158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:24.732764 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:24.732712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl" podStartSLOduration=1.770214217 podStartE2EDuration="3.732695425s" totalImagesPullingTime="1.962481208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:21:24.73037015 +0000 UTC m=+603.633015161" watchObservedRunningTime="2026-07-25 01:21:24.732695425 +0000 UTC m=+603.635340436"
Jul 25 01:21:29.744658 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.744551    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad96367b-ec55-4b0a-86cc-587672b0545d" containerID="a63af827fc2d980e348d80ca75a6b4368a50a09c2b0c8c67fa52538e3e689270" exitCode=0
Jul 25 01:21:29.744658 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.744622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" event={"ID":"ad96367b-ec55-4b0a-86cc-587672b0545d","Type":"ContainerDied","Data":"a63af827fc2d980e348d80ca75a6b4368a50a09c2b0c8c67fa52538e3e689270"}
Jul 25 01:21:29.745159 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.745119    2565 scope.go:117] "RemoveContainer" containerID="a63af827fc2d980e348d80ca75a6b4368a50a09c2b0c8c67fa52538e3e689270"
Jul 25 01:21:29.746168 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.746139    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:29.746279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.746204    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:29.746279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:29.746238    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:30.751374 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:30.751334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" event={"ID":"ad96367b-ec55-4b0a-86cc-587672b0545d","Type":"ContainerStarted","Data":"de17a62d337c6acf4d783b1375facc60931946614a7b54c92616ff2b1ab3f560"}
Jul 25 01:21:31.201464 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:31.201412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:21:31.202611 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:31.202583    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s7c86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 25 01:21:31.202691 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:31.202639    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" podUID="ad96367b-ec55-4b0a-86cc-587672b0545d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 25 01:21:32.201825 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:32.201783    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s7c86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 25 01:21:32.202380 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:32.202323    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" podUID="ad96367b-ec55-4b0a-86cc-587672b0545d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 25 01:21:32.250213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:32.250174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:32.354423 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:32.354381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:33.201577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:33.201537    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s7c86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 25 01:21:33.201811 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:33.201598    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" podUID="ad96367b-ec55-4b0a-86cc-587672b0545d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 25 01:21:34.202072 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:34.202035    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s7c86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 25 01:21:34.202543 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:34.202096    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86" podUID="ad96367b-ec55-4b0a-86cc-587672b0545d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 25 01:21:34.234825 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:34.234794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:21:35.205453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:35.205421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:21:35.206624 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:35.206602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s7c86"
Jul 25 01:21:35.707201 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:35.707163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:35.726693 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:35.726666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-79szl"
Jul 25 01:21:35.808731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:35.808694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:21:49.054320 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:21:49.054226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:00.430548 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.430496    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"]
Jul 25 01:22:00.433338 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.433316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.435252 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.435227    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 25 01:22:00.435378 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.435283    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 25 01:22:00.435649 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.435633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rj5g5\""
Jul 25 01:22:00.435741 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.435641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 25 01:22:00.444857 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.444829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"]
Jul 25 01:22:00.530359 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.530320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:00.586750 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.586707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.586750 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.586749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8e3af0-1e94-47af-b518-526cd0306538-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.586984 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.586784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csdz2\" (UniqueName: \"kubernetes.io/projected/7b8e3af0-1e94-47af-b518-526cd0306538-kube-api-access-csdz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.586984 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.586880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.587053 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.586981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.587053 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.587024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.687790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.687790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.687790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8e3af0-1e94-47af-b518-526cd0306538-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csdz2\" (UniqueName: \"kubernetes.io/projected/7b8e3af0-1e94-47af-b518-526cd0306538-kube-api-access-csdz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688054 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.687889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688229 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.688174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688229 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.688204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.688335 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.688231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.690163 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.690127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8e3af0-1e94-47af-b518-526cd0306538-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.690386 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.690366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8e3af0-1e94-47af-b518-526cd0306538-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.694481 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.694457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csdz2\" (UniqueName: \"kubernetes.io/projected/7b8e3af0-1e94-47af-b518-526cd0306538-kube-api-access-csdz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvqvg\" (UID: \"7b8e3af0-1e94-47af-b518-526cd0306538\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.744995 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.744950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:00.886551 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.886520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"]
Jul 25 01:22:00.889609 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:22:00.889572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8e3af0_1e94_47af_b518_526cd0306538.slice/crio-ae0eed020f601bb0aa054484a791f9425251834248cc81b47c31e997e0e14fee WatchSource:0}: Error finding container ae0eed020f601bb0aa054484a791f9425251834248cc81b47c31e997e0e14fee: Status 404 returned error can't find the container with id ae0eed020f601bb0aa054484a791f9425251834248cc81b47c31e997e0e14fee
Jul 25 01:22:00.891102 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.891081    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:22:00.902929 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:00.902893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg" event={"ID":"7b8e3af0-1e94-47af-b518-526cd0306538","Type":"ContainerStarted","Data":"ae0eed020f601bb0aa054484a791f9425251834248cc81b47c31e997e0e14fee"}
Jul 25 01:22:01.642704 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:01.642622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:01.749892 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:01.749832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:02.914816 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:02.914785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg" event={"ID":"7b8e3af0-1e94-47af-b518-526cd0306538","Type":"ContainerStarted","Data":"f481759d3e40b9bfd462f999b8fa96400fbf91b14ff511abe2fd666a232aafc0"}
Jul 25 01:22:02.931553 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:02.931478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg" podStartSLOduration=1.973118381 podStartE2EDuration="2.931457496s" totalImagesPullingTime="958.339115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:22:02.929538057 +0000 UTC m=+641.832183070" watchObservedRunningTime="2026-07-25 01:22:02.931457496 +0000 UTC m=+641.834102507"
Jul 25 01:22:10.745431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:10.745385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:10.745957 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:10.745500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:10.762292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:10.762263    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:10.976856 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:10.976821    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvqvg"
Jul 25 01:22:19.123591 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.123556    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"]
Jul 25 01:22:19.127120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.127103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.128761 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.128727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 25 01:22:19.136615 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.136587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"]
Jul 25 01:22:19.148358 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.148314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:19.183158 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef685094-9a59-4a22-be88-2fd33ebed448-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.183347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.183347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.183453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.183453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlk6g\" (UniqueName: \"kubernetes.io/projected/ef685094-9a59-4a22-be88-2fd33ebed448-kube-api-access-jlk6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.183453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.183433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.284785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef685094-9a59-4a22-be88-2fd33ebed448-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.284785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlk6g\" (UniqueName: \"kubernetes.io/projected/ef685094-9a59-4a22-be88-2fd33ebed448-kube-api-access-jlk6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.284938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285305 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.285224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285361 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.285339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.285412 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.285386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.287407 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.287381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef685094-9a59-4a22-be88-2fd33ebed448-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.287560 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.287543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef685094-9a59-4a22-be88-2fd33ebed448-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.291996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.291970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlk6g\" (UniqueName: \"kubernetes.io/projected/ef685094-9a59-4a22-be88-2fd33ebed448-kube-api-access-jlk6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnx\" (UID: \"ef685094-9a59-4a22-be88-2fd33ebed448\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.439575 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.439423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:19.583109 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:19.583075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"]
Jul 25 01:22:19.586821 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:22:19.586780    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef685094_9a59_4a22_be88_2fd33ebed448.slice/crio-4a7df1a6d4af01fcd06300aa1310c5633798dece4193086b05cfe1c182c2e924 WatchSource:0}: Error finding container 4a7df1a6d4af01fcd06300aa1310c5633798dece4193086b05cfe1c182c2e924: Status 404 returned error can't find the container with id 4a7df1a6d4af01fcd06300aa1310c5633798dece4193086b05cfe1c182c2e924
Jul 25 01:22:20.015144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:20.015105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx" event={"ID":"ef685094-9a59-4a22-be88-2fd33ebed448","Type":"ContainerStarted","Data":"bf970656a0252f2489b26730c95d9cf26373ca16631276331b7a49671d7a35da"}
Jul 25 01:22:20.015338 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:20.015172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx" event={"ID":"ef685094-9a59-4a22-be88-2fd33ebed448","Type":"ContainerStarted","Data":"4a7df1a6d4af01fcd06300aa1310c5633798dece4193086b05cfe1c182c2e924"}
Jul 25 01:22:20.031121 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:20.031065    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx" podStartSLOduration=0.824458306 podStartE2EDuration="1.031045807s" totalImagesPullingTime="206.587501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:22:20.029134322 +0000 UTC m=+658.931779337" watchObservedRunningTime="2026-07-25 01:22:20.031045807 +0000 UTC m=+658.933690819"
Jul 25 01:22:27.464206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:27.464169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:22:29.440556 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:29.440487    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:29.441064 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:29.440585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:29.453140 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:29.453113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:30.077939 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:30.077898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnx"
Jul 25 01:22:48.347501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:22:48.347457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:03.863734 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:03.863703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:22.227731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:22.227642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:22.279443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:22.279409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:57.604782 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:57.604736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:57.698323 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:57.698279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:58.766399 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:58.766362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:23:58.865332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:23:58.865294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:24:53.955559 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:53.955448    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:24:53.956208 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:53.955692    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" podUID="1be3415d-8403-4049-8c7d-b2bacd03c894" containerName="manager" containerID="cri-o://95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514" gracePeriod=30
Jul 25 01:24:54.222596 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.222565    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:24:54.392593 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.392554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9lf7\" (UniqueName: \"kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7\") pod \"1be3415d-8403-4049-8c7d-b2bacd03c894\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") "
Jul 25 01:24:54.392805 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.392604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert\") pod \"1be3415d-8403-4049-8c7d-b2bacd03c894\" (UID: \"1be3415d-8403-4049-8c7d-b2bacd03c894\") "
Jul 25 01:24:54.394795 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.394762    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7" (OuterVolumeSpecName: "kube-api-access-n9lf7") pod "1be3415d-8403-4049-8c7d-b2bacd03c894" (UID: "1be3415d-8403-4049-8c7d-b2bacd03c894"). InnerVolumeSpecName "kube-api-access-n9lf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:24:54.394795 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.394780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1be3415d-8403-4049-8c7d-b2bacd03c894" (UID: "1be3415d-8403-4049-8c7d-b2bacd03c894"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:24:54.494253 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.494146    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9lf7\" (UniqueName: \"kubernetes.io/projected/1be3415d-8403-4049-8c7d-b2bacd03c894-kube-api-access-n9lf7\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:24:54.494253 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.494191    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1be3415d-8403-4049-8c7d-b2bacd03c894-webhook-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:24:54.796476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.796366    2565 generic.go:356] "Generic (PLEG): container finished" podID="1be3415d-8403-4049-8c7d-b2bacd03c894" containerID="95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514" exitCode=0
Jul 25 01:24:54.796476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.796406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" event={"ID":"1be3415d-8403-4049-8c7d-b2bacd03c894","Type":"ContainerDied","Data":"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"}
Jul 25 01:24:54.796476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.796420    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-5272r"
Jul 25 01:24:54.796476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.796444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-5272r" event={"ID":"1be3415d-8403-4049-8c7d-b2bacd03c894","Type":"ContainerDied","Data":"b807db762db8d6b341a6e1cf39560e7e976c5c5b41e6203821c3f959c7adb1c4"}
Jul 25 01:24:54.796476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.796465    2565 scope.go:117] "RemoveContainer" containerID="95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"
Jul 25 01:24:54.811880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.811797    2565 scope.go:117] "RemoveContainer" containerID="95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"
Jul 25 01:24:54.812289 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:24:54.812250    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514\": container with ID starting with 95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514 not found: ID does not exist" containerID="95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"
Jul 25 01:24:54.812369 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.812302    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514"} err="failed to get container status \"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514\": rpc error: code = NotFound desc = could not find container \"95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514\": container with ID starting with 95629bb03efb9bc6b4ec8864964fa25f92c90dceef9a654f9aef08c7f4f2e514 not found: ID does not exist"
Jul 25 01:24:54.824185 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.824152    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:24:54.829711 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:54.829678    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-5272r"]
Jul 25 01:24:55.645181 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:55.645143    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be3415d-8403-4049-8c7d-b2bacd03c894" path="/var/lib/kubelet/pods/1be3415d-8403-4049-8c7d-b2bacd03c894/volumes"
Jul 25 01:24:57.844028 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:24:57.843996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:25:18.703501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:18.703460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:25:55.654613 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.654578    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:25:55.655197 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.655176    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be3415d-8403-4049-8c7d-b2bacd03c894" containerName="manager"
Jul 25 01:25:55.655248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.655201    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be3415d-8403-4049-8c7d-b2bacd03c894" containerName="manager"
Jul 25 01:25:55.655292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.655281    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be3415d-8403-4049-8c7d-b2bacd03c894" containerName="manager"
Jul 25 01:25:55.658417 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.658395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:25:55.658576 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.658483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.660775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.660749    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m2pdl\""
Jul 25 01:25:55.660775 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.660760    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 25 01:25:55.660993 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.660784    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 25 01:25:55.823164 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.823121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt8hx\" (UniqueName: \"kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.823375 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.823216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.924603 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.924465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.924603 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.924602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt8hx\" (UniqueName: \"kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.927204 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.927166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.931837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.931807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt8hx\" (UniqueName: \"kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx\") pod \"maas-controller-cd5dc4b6d-2tjbv\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") " pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:55.969841 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:55.969795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:56.109607 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:56.109564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:25:56.112915 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:25:56.112867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f255234_eb58_4e69_9aa4_54cd134a218f.slice/crio-26398c5cdb1e1b1519b3ae19d44dc9300b81af96524a5adeb99a747598171993 WatchSource:0}: Error finding container 26398c5cdb1e1b1519b3ae19d44dc9300b81af96524a5adeb99a747598171993: Status 404 returned error can't find the container with id 26398c5cdb1e1b1519b3ae19d44dc9300b81af96524a5adeb99a747598171993
Jul 25 01:25:57.108437 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:57.108333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" event={"ID":"0f255234-eb58-4e69-9aa4-54cd134a218f","Type":"ContainerStarted","Data":"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"}
Jul 25 01:25:57.108437 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:57.108398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:25:57.108437 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:57.108417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" event={"ID":"0f255234-eb58-4e69-9aa4-54cd134a218f","Type":"ContainerStarted","Data":"26398c5cdb1e1b1519b3ae19d44dc9300b81af96524a5adeb99a747598171993"}
Jul 25 01:25:57.126319 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:25:57.126261    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" podStartSLOduration=1.4094689919999999 podStartE2EDuration="2.126245158s" totalImagesPullingTime="716.776166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:25:57.124270697 +0000 UTC m=+876.026915710" watchObservedRunningTime="2026-07-25 01:25:57.126245158 +0000 UTC m=+876.028890168"
Jul 25 01:26:06.990281 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:06.990243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:08.116800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:08.116700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:26:12.679487 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:12.679393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:12.792646 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:12.792613    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:26:12.792900 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:12.792863    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" podUID="0f255234-eb58-4e69-9aa4-54cd134a218f" containerName="manager" containerID="cri-o://07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443" gracePeriod=30
Jul 25 01:26:13.052450 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.052421    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:26:13.094374 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.094340    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert\") pod \"0f255234-eb58-4e69-9aa4-54cd134a218f\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") "
Jul 25 01:26:13.094613 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.094390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt8hx\" (UniqueName: \"kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx\") pod \"0f255234-eb58-4e69-9aa4-54cd134a218f\" (UID: \"0f255234-eb58-4e69-9aa4-54cd134a218f\") "
Jul 25 01:26:13.096489 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.096461    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f255234-eb58-4e69-9aa4-54cd134a218f" (UID: "0f255234-eb58-4e69-9aa4-54cd134a218f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:26:13.096616 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.096455    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx" (OuterVolumeSpecName: "kube-api-access-kt8hx") pod "0f255234-eb58-4e69-9aa4-54cd134a218f" (UID: "0f255234-eb58-4e69-9aa4-54cd134a218f"). InnerVolumeSpecName "kube-api-access-kt8hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:26:13.194059 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.194018    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f255234-eb58-4e69-9aa4-54cd134a218f" containerID="07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443" exitCode=0
Jul 25 01:26:13.194266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.194068    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv"
Jul 25 01:26:13.194266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.194103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" event={"ID":"0f255234-eb58-4e69-9aa4-54cd134a218f","Type":"ContainerDied","Data":"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"}
Jul 25 01:26:13.194266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.194158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-2tjbv" event={"ID":"0f255234-eb58-4e69-9aa4-54cd134a218f","Type":"ContainerDied","Data":"26398c5cdb1e1b1519b3ae19d44dc9300b81af96524a5adeb99a747598171993"}
Jul 25 01:26:13.194266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.194197    2565 scope.go:117] "RemoveContainer" containerID="07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"
Jul 25 01:26:13.195150 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.195125    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f255234-eb58-4e69-9aa4-54cd134a218f-webhook-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:26:13.195150 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.195148    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt8hx\" (UniqueName: \"kubernetes.io/projected/0f255234-eb58-4e69-9aa4-54cd134a218f-kube-api-access-kt8hx\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:26:13.203828 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.203804    2565 scope.go:117] "RemoveContainer" containerID="07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"
Jul 25 01:26:13.204160 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:26:13.204140    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443\": container with ID starting with 07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443 not found: ID does not exist" containerID="07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"
Jul 25 01:26:13.204247 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.204172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443"} err="failed to get container status \"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443\": rpc error: code = NotFound desc = could not find container \"07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443\": container with ID starting with 07ac40dca7afb700904e79f1ce561763d76729ed2fe13460d85b1bd020332443 not found: ID does not exist"
Jul 25 01:26:13.215136 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.215107    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:26:13.218451 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.218388    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-2tjbv"]
Jul 25 01:26:13.645905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.645864    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f255234-eb58-4e69-9aa4-54cd134a218f" path="/var/lib/kubelet/pods/0f255234-eb58-4e69-9aa4-54cd134a218f/volumes"
Jul 25 01:26:13.919329 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:13.919229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:14.044620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.044578    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-wt6vf"]
Jul 25 01:26:14.045258 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.045234    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f255234-eb58-4e69-9aa4-54cd134a218f" containerName="manager"
Jul 25 01:26:14.045360 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.045262    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f255234-eb58-4e69-9aa4-54cd134a218f" containerName="manager"
Jul 25 01:26:14.045442 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.045375    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f255234-eb58-4e69-9aa4-54cd134a218f" containerName="manager"
Jul 25 01:26:14.050417 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.050388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.052761 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.052721    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 25 01:26:14.052761 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.052721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m2pdl\""
Jul 25 01:26:14.053010 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.052726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 25 01:26:14.057571 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.057541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-wt6vf"]
Jul 25 01:26:14.105980 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.105930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b4860d-8947-42bb-8492-b48e149c8179-webhook-cert\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.106191 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.106101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lnbt\" (UniqueName: \"kubernetes.io/projected/76b4860d-8947-42bb-8492-b48e149c8179-kube-api-access-5lnbt\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.207123 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.207018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b4860d-8947-42bb-8492-b48e149c8179-webhook-cert\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.207321 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.207128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lnbt\" (UniqueName: \"kubernetes.io/projected/76b4860d-8947-42bb-8492-b48e149c8179-kube-api-access-5lnbt\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.209683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.209658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b4860d-8947-42bb-8492-b48e149c8179-webhook-cert\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.214453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.214423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lnbt\" (UniqueName: \"kubernetes.io/projected/76b4860d-8947-42bb-8492-b48e149c8179-kube-api-access-5lnbt\") pod \"maas-controller-cd5dc4b6d-wt6vf\" (UID: \"76b4860d-8947-42bb-8492-b48e149c8179\") " pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.365222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.365185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:14.505924 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:14.505891    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd5dc4b6d-wt6vf"]
Jul 25 01:26:14.509052 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:26:14.509020    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b4860d_8947_42bb_8492_b48e149c8179.slice/crio-16fc0acdd0ad16f924da88270a1cb3edbe4ef4ec1a69baae02cf091550c4a443 WatchSource:0}: Error finding container 16fc0acdd0ad16f924da88270a1cb3edbe4ef4ec1a69baae02cf091550c4a443: Status 404 returned error can't find the container with id 16fc0acdd0ad16f924da88270a1cb3edbe4ef4ec1a69baae02cf091550c4a443
Jul 25 01:26:15.206757 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:15.206712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf" event={"ID":"76b4860d-8947-42bb-8492-b48e149c8179","Type":"ContainerStarted","Data":"3370403e546583b2d99ec4ff9b4462537ba3f4ce7e0ad8b66f7fdaa6f2828b6a"}
Jul 25 01:26:15.207266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:15.206821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf" event={"ID":"76b4860d-8947-42bb-8492-b48e149c8179","Type":"ContainerStarted","Data":"16fc0acdd0ad16f924da88270a1cb3edbe4ef4ec1a69baae02cf091550c4a443"}
Jul 25 01:26:15.207266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:15.206853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:15.223747 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:15.223619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf" podStartSLOduration=0.773332459 podStartE2EDuration="1.223600098s" totalImagesPullingTime="450.267639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:26:15.22114711 +0000 UTC m=+894.123792122" watchObservedRunningTime="2026-07-25 01:26:15.223600098 +0000 UTC m=+894.126245138"
Jul 25 01:26:26.214145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:26.214107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cd5dc4b6d-wt6vf"
Jul 25 01:26:47.331898 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:47.331857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:47.433392 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:47.433347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:47.569458 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:47.569424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:53.263348 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:53.263309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:53.367317 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:53.367275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:53.460976 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:53.460940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:53.630108 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:53.630074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:59.637334 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:59.637277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:26:59.737298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:26:59.737258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:30:00.141926 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.141885    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"]
Jul 25 01:30:00.145725 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.145701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"
Jul 25 01:30:00.147557 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.147534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:30:00.158871 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.158837    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"]
Jul 25 01:30:00.159222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.159199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"
Jul 25 01:30:00.322002 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.321973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"]
Jul 25 01:30:00.324594 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:30:00.324563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c8c394_2dc2_4506_9ebc_8076094fe65c.slice/crio-34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5 WatchSource:0}: Error finding container 34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5: Status 404 returned error can't find the container with id 34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5
Jul 25 01:30:00.326523 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.326493    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:30:00.394970 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:00.394869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz" event={"ID":"b1c8c394-2dc2-4506-9ebc-8076094fe65c","Type":"ContainerStarted","Data":"34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5"}
Jul 25 01:30:03.413819 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:03.413779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz" event={"ID":"b1c8c394-2dc2-4506-9ebc-8076094fe65c","Type":"ContainerStarted","Data":"2d6b5717569696a93fb32643891a7cb579841df71b9e79da84ab41a07633cee9"}
Jul 25 01:30:03.427211 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:03.427154    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz" podStartSLOduration=0.825398812 podStartE2EDuration="3.427135777s" totalImagesPullingTime="2.601736965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:30:03.426139626 +0000 UTC m=+1122.328784636" watchObservedRunningTime="2026-07-25 01:30:03.427135777 +0000 UTC m=+1122.329780815"
Jul 25 01:30:04.420350 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:04.420309    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1c8c394-2dc2-4506-9ebc-8076094fe65c" containerID="2d6b5717569696a93fb32643891a7cb579841df71b9e79da84ab41a07633cee9" exitCode=0
Jul 25 01:30:04.420784 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:04.420393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz" event={"ID":"b1c8c394-2dc2-4506-9ebc-8076094fe65c","Type":"ContainerDied","Data":"2d6b5717569696a93fb32643891a7cb579841df71b9e79da84ab41a07633cee9"}
Jul 25 01:30:05.574704 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:05.574676    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"
Jul 25 01:30:06.432256 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:06.432226    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"
Jul 25 01:30:06.432417 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:06.432275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz" event={"ID":"b1c8c394-2dc2-4506-9ebc-8076094fe65c","Type":"ContainerDied","Data":"34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5"}
Jul 25 01:30:06.432417 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:06.432324    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34320726be8e250eab6a19200b8e5e82e06c13fa5e2fb0359ab9e5ed6d3e44e5"
Jul 25 01:30:33.740058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:33.740017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:30:54.757324 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:54.757228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:30:54.859014 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:30:54.858965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:34:27.479814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:34:27.479773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:34:29.175974 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:34:29.175939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:34:31.448911 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:34:31.448852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:35:12.811205 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:35:12.811101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:35:13.153879 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:35:13.153840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:36:30.512945 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:36:30.512883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:36:51.652120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:36:51.652030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:25.855849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:25.855769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:45.127806 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:45.127771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:48.288525 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:48.288465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:48.390807 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:48.390769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:48.653130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:48.653082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:48.754141 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:48.754104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:48.853814 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:48.853780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:54.416135 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.416095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:54.517832 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.517792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:54.630634 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.630588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:54.928231 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.928196    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:38:54.928687 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.928673    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c8c394-2dc2-4506-9ebc-8076094fe65c" containerName="cleanup"
Jul 25 01:38:54.928753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.928689    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c8c394-2dc2-4506-9ebc-8076094fe65c" containerName="cleanup"
Jul 25 01:38:54.928753 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.928753    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c8c394-2dc2-4506-9ebc-8076094fe65c" containerName="cleanup"
Jul 25 01:38:54.931963 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.931943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:54.933903 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.933878    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-04dad736-openshift-default-dockercfg-5lptd\""
Jul 25 01:38:54.951702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.951660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:38:54.953935 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:54.953902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:55.059993 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.059944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz62q\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.059993 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.059992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.060432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.060350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.156692 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.156655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:55.161494 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161620 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161846 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161910 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz62q\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.161959 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.161927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.162295 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.162273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.162408 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.162384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.162408 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.162399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.162538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.162432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.162538 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.162481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.164131 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.164110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.164224 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.164165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.169456 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.169427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz62q\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.169783 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.169767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token\") pod \"e2e-ait-04dad736-openshift-default-57bf845958-cgj29\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") " pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.243301 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.243199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:55.403817 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.403787    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:38:55.406131 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:38:55.406093    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd077413f_d115_4f22_b1aa_9482f24d5b1d.slice/crio-41bd03e26224037859501244e71a30018c67a4225493ebd84d15be1d41b59e91 WatchSource:0}: Error finding container 41bd03e26224037859501244e71a30018c67a4225493ebd84d15be1d41b59e91: Status 404 returned error can't find the container with id 41bd03e26224037859501244e71a30018c67a4225493ebd84d15be1d41b59e91
Jul 25 01:38:55.408439 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.408400    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:38:55.408577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.408477    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:38:55.408577 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:55.408527    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:38:56.204638 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:56.204598    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerStarted","Data":"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"}
Jul 25 01:38:56.205096 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:56.204656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerStarted","Data":"41bd03e26224037859501244e71a30018c67a4225493ebd84d15be1d41b59e91"}
Jul 25 01:38:56.223166 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:56.223098    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podStartSLOduration=2.223073629 podStartE2EDuration="2.223073629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:38:56.221734746 +0000 UTC m=+1655.124379758" watchObservedRunningTime="2026-07-25 01:38:56.223073629 +0000 UTC m=+1655.125718643"
Jul 25 01:38:56.243453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:56.243410    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:56.248921 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:56.248883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:57.210711 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:57.210678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:57.211641 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:57.211621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:38:57.547561 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:57.547448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:57.626290 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:57.626253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:57.683502 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:57.683465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:58.123828 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.123783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:58.222156 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.222122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:38:58.234750 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.234719    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:38:58.238332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.238310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.240467 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.240438    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-04dad736\""
Jul 25 01:38:58.240654 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.240448    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-04dad736-dockercfg-f9qjq\""
Jul 25 01:38:58.254041 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.254012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:38:58.255999 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.255966    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:38:58.259627 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.259609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.266311 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.266272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:38:58.397849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.397748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.397849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.397820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.397849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.397841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cns4n\" (UniqueName: \"kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.398090 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.397894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnxf7\" (UniqueName: \"kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.499136 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.499096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnxf7\" (UniqueName: \"kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.499342 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.499226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.499342 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.499268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.499342 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.499291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cns4n\" (UniqueName: \"kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.500053 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.500029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.500110 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.500039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.506426 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.506391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnxf7\" (UniqueName: \"kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7\") pod \"payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.506614 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.506431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cns4n\" (UniqueName: \"kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n\") pod \"payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") " pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.550475 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.550436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:58.572790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.572756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:58.704969 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.704925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:38:58.709629 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:38:58.709581    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9c213f_a89e_4c1d_8392_52e025f0bbdc.slice/crio-3ac6a74b5623a7d916aaab3ccab427cbdbb7fdb0d3db9d42eecdb9f3e2249f5b WatchSource:0}: Error finding container 3ac6a74b5623a7d916aaab3ccab427cbdbb7fdb0d3db9d42eecdb9f3e2249f5b: Status 404 returned error can't find the container with id 3ac6a74b5623a7d916aaab3ccab427cbdbb7fdb0d3db9d42eecdb9f3e2249f5b
Jul 25 01:38:58.740327 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:58.740299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:38:58.749006 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:38:58.748964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836b65f1_2d4c_4dcd_8ea5_e60d3dd6ff91.slice/crio-4dccad8dd329c914071883a6d3df3669dfba1b38fd38e7cb8786975c32034dd5 WatchSource:0}: Error finding container 4dccad8dd329c914071883a6d3df3669dfba1b38fd38e7cb8786975c32034dd5: Status 404 returned error can't find the container with id 4dccad8dd329c914071883a6d3df3669dfba1b38fd38e7cb8786975c32034dd5
Jul 25 01:38:59.225349 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.225307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" event={"ID":"9d9c213f-a89e-4c1d-8392-52e025f0bbdc","Type":"ContainerStarted","Data":"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"}
Jul 25 01:38:59.225882 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.225374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" event={"ID":"9d9c213f-a89e-4c1d-8392-52e025f0bbdc","Type":"ContainerStarted","Data":"3ac6a74b5623a7d916aaab3ccab427cbdbb7fdb0d3db9d42eecdb9f3e2249f5b"}
Jul 25 01:38:59.225882 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.225407    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:38:59.227117 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.227079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" event={"ID":"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91","Type":"ContainerStarted","Data":"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"}
Jul 25 01:38:59.227332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.227307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:38:59.227434 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.227360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" event={"ID":"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91","Type":"ContainerStarted","Data":"4dccad8dd329c914071883a6d3df3669dfba1b38fd38e7cb8786975c32034dd5"}
Jul 25 01:38:59.241182 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.241096    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" podStartSLOduration=1.241070899 podStartE2EDuration="1.241070899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:38:59.239788101 +0000 UTC m=+1658.142433113" watchObservedRunningTime="2026-07-25 01:38:59.241070899 +0000 UTC m=+1658.143715913"
Jul 25 01:38:59.257178 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:38:59.257113    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" podStartSLOduration=1.257093171 podStartE2EDuration="1.257093171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:38:59.255201187 +0000 UTC m=+1658.157846199" watchObservedRunningTime="2026-07-25 01:38:59.257093171 +0000 UTC m=+1658.159738210"
Jul 25 01:39:10.234651 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:10.234618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:39:10.235077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:10.234787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:39:12.640143 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:12.640111    2565 patch_prober.go:28] interesting pod/e2e-ait-04dad736-openshift-default-57bf845958-cgj29 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:60726->10.134.0.37:15021: read: connection reset by peer" start-of-body=
Jul 25 01:39:12.640607 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:12.640185    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:60726->10.134.0.37:15021: read: connection reset by peer"
Jul 25 01:39:13.304304 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.304269    2565 generic.go:356] "Generic (PLEG): container finished" podID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerID="dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62" exitCode=0
Jul 25 01:39:13.304491 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.304339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerDied","Data":"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"}
Jul 25 01:39:13.304876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.304861    2565 scope.go:117] "RemoveContainer" containerID="dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"
Jul 25 01:39:13.305961 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.305937    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:39:13.306019 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.306002    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:39:13.306053 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:13.306031    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:39:14.311628 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:14.311588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerStarted","Data":"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"}
Jul 25 01:39:15.244087 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:15.244046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:39:15.244277 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:15.244225    2565 patch_prober.go:28] interesting pod/e2e-ait-04dad736-openshift-default-57bf845958-cgj29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 25 01:39:15.244324 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:15.244277    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 25 01:39:16.243619 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:16.243579    2565 patch_prober.go:28] interesting pod/e2e-ait-04dad736-openshift-default-57bf845958-cgj29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 25 01:39:16.244040 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:16.243638    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 25 01:39:17.244007 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:17.243970    2565 patch_prober.go:28] interesting pod/e2e-ait-04dad736-openshift-default-57bf845958-cgj29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 25 01:39:17.244431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:17.244024    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 25 01:39:18.244488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:18.244442    2565 patch_prober.go:28] interesting pod/e2e-ait-04dad736-openshift-default-57bf845958-cgj29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 25 01:39:18.244939 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:18.244543    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 25 01:39:19.247386 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:19.247350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:39:19.247874 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:19.247739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:39:19.248684 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:39:19.248660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:41:48.976925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:41:48.976891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:41:49.983537 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:41:49.983460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:04.097970 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.097921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"]
Jul 25 01:44:04.101678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.101655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:04.103755 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.103723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 01:44:04.103931 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.103779    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:44:04.115587 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.115541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"]
Jul 25 01:44:04.234749 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.234705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-04dad736-68kh2\" (UID: \"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:04.335991 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.335945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-04dad736-68kh2\" (UID: \"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:04.336697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.336661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-04dad736-68kh2\" (UID: \"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:04.412852 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.412745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:04.563847 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.563797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"]
Jul 25 01:44:04.566350 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:44:04.566319    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee28ce82_a7ad_4c9c_95b9_62fa68953b0f.slice/crio-5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2 WatchSource:0}: Error finding container 5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2: Status 404 returned error can't find the container with id 5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2
Jul 25 01:44:04.896791 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.896744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2" event={"ID":"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f","Type":"ContainerStarted","Data":"f7a1da974b1f4135ba6901260ef52c2b82891811e269672b0132722d11f203c0"}
Jul 25 01:44:04.897016 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.896860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2" event={"ID":"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f","Type":"ContainerStarted","Data":"5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2"}
Jul 25 01:44:04.911868 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:04.911802    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2" podStartSLOduration=0.911784513 podStartE2EDuration="911.784513ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:44:04.909003147 +0000 UTC m=+1963.811648160" watchObservedRunningTime="2026-07-25 01:44:04.911784513 +0000 UTC m=+1963.814429524"
Jul 25 01:44:05.903789 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:05.903753    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" containerID="f7a1da974b1f4135ba6901260ef52c2b82891811e269672b0132722d11f203c0" exitCode=0
Jul 25 01:44:05.904292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:05.903845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2" event={"ID":"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f","Type":"ContainerDied","Data":"f7a1da974b1f4135ba6901260ef52c2b82891811e269672b0132722d11f203c0"}
Jul 25 01:44:07.064372 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.064339    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:07.166856 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.166752    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca\") pod \"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f\" (UID: \"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f\") "
Jul 25 01:44:07.167192 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.167166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" (UID: "ee28ce82-a7ad-4c9c-95b9-62fa68953b0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:44:07.268663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.268621    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:07.916808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.916708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2" event={"ID":"ee28ce82-a7ad-4c9c-95b9-62fa68953b0f","Type":"ContainerDied","Data":"5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2"}
Jul 25 01:44:07.916808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.916767    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8740417853668987772e1aa8c1be1eaed788e7d9ba01ed30f1fb94919ad5b2"
Jul 25 01:44:07.916808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:07.916725    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"
Jul 25 01:44:14.573853 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.573742    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:44:14.574441 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.574093    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" podUID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" containerName="payload-processing" containerID="cri-o://91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63" gracePeriod=30
Jul 25 01:44:14.576190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.576144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:14.581785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.581644    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:44:14.582001 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.581894    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" podUID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" containerName="payload-pre-processing" containerID="cri-o://1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15" gracePeriod=30
Jul 25 01:44:14.659148 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.659110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:14.887379 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.887347    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:44:14.890664 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.890634    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:44:14.950485 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.950453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume\") pod \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") "
Jul 25 01:44:14.950815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.950541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cns4n\" (UniqueName: \"kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n\") pod \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") "
Jul 25 01:44:14.950815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.950579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnxf7\" (UniqueName: \"kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7\") pod \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\" (UID: \"9d9c213f-a89e-4c1d-8392-52e025f0bbdc\") "
Jul 25 01:44:14.950815 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.950601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume\") pod \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\" (UID: \"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91\") "
Jul 25 01:44:14.950996 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.950892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d9c213f-a89e-4c1d-8392-52e025f0bbdc" (UID: "9d9c213f-a89e-4c1d-8392-52e025f0bbdc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:44:14.951049 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.951010    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:14.951107 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.951076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" (UID: "836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:44:14.953063 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.953037    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7" (OuterVolumeSpecName: "kube-api-access-mnxf7") pod "9d9c213f-a89e-4c1d-8392-52e025f0bbdc" (UID: "9d9c213f-a89e-4c1d-8392-52e025f0bbdc"). InnerVolumeSpecName "kube-api-access-mnxf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:44:14.953185 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.953104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n" (OuterVolumeSpecName: "kube-api-access-cns4n") pod "836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" (UID: "836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91"). InnerVolumeSpecName "kube-api-access-cns4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:44:14.956377 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.956350    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" containerID="1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15" exitCode=0
Jul 25 01:44:14.956600 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.956406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"
Jul 25 01:44:14.956600 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.956436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" event={"ID":"9d9c213f-a89e-4c1d-8392-52e025f0bbdc","Type":"ContainerDied","Data":"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"}
Jul 25 01:44:14.956600 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.956547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9" event={"ID":"9d9c213f-a89e-4c1d-8392-52e025f0bbdc","Type":"ContainerDied","Data":"3ac6a74b5623a7d916aaab3ccab427cbdbb7fdb0d3db9d42eecdb9f3e2249f5b"}
Jul 25 01:44:14.956600 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.956580    2565 scope.go:117] "RemoveContainer" containerID="1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"
Jul 25 01:44:14.958076 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.958053    2565 generic.go:356] "Generic (PLEG): container finished" podID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" containerID="91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63" exitCode=0
Jul 25 01:44:14.958190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.958106    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"
Jul 25 01:44:14.958190 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.958133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" event={"ID":"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91","Type":"ContainerDied","Data":"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"}
Jul 25 01:44:14.958267 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.958201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx" event={"ID":"836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91","Type":"ContainerDied","Data":"4dccad8dd329c914071883a6d3df3669dfba1b38fd38e7cb8786975c32034dd5"}
Jul 25 01:44:14.966561 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.966540    2565 scope.go:117] "RemoveContainer" containerID="1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"
Jul 25 01:44:14.966973 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:44:14.966945    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15\": container with ID starting with 1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15 not found: ID does not exist" containerID="1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"
Jul 25 01:44:14.967077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.966985    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15"} err="failed to get container status \"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15\": rpc error: code = NotFound desc = could not find container \"1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15\": container with ID starting with 1eceabe00b5277e24d370f7121ddd30a3412a0715eea2a9e7b22ab8ed1680d15 not found: ID does not exist"
Jul 25 01:44:14.967077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.967009    2565 scope.go:117] "RemoveContainer" containerID="91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"
Jul 25 01:44:14.976449 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.976420    2565 scope.go:117] "RemoveContainer" containerID="91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"
Jul 25 01:44:14.976825 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:44:14.976802    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63\": container with ID starting with 91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63 not found: ID does not exist" containerID="91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"
Jul 25 01:44:14.976882 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.976837    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63"} err="failed to get container status \"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63\": rpc error: code = NotFound desc = could not find container \"91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63\": container with ID starting with 91b17f86a952bec12af421bdb48b9048eb3ba798d7ba8801d6f1e18352b8eb63 not found: ID does not exist"
Jul 25 01:44:14.982326 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.982291    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:44:14.986374 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.986344    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dad736-56999c44dd-b8cd9"]
Jul 25 01:44:14.995384 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.995346    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:44:14.998536 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:14.998491    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dad736-85bf7b7b6-fctqx"]
Jul 25 01:44:15.051639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:15.051609    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cns4n\" (UniqueName: \"kubernetes.io/projected/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-kube-api-access-cns4n\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:15.051639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:15.051637    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnxf7\" (UniqueName: \"kubernetes.io/projected/9d9c213f-a89e-4c1d-8392-52e025f0bbdc-kube-api-access-mnxf7\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:15.051639 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:15.051647    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:15.645820 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:15.645781    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" path="/var/lib/kubelet/pods/836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91/volumes"
Jul 25 01:44:15.646222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:15.646174    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" path="/var/lib/kubelet/pods/9d9c213f-a89e-4c1d-8392-52e025f0bbdc/volumes"
Jul 25 01:44:19.165241 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.165198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:19.184413 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.184359    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"]
Jul 25 01:44:19.184680 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.184432    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-04dad736-68kh2"]
Jul 25 01:44:19.313430 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.313387    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:44:19.313756 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.313727    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy" containerID="cri-o://11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690" gracePeriod=30
Jul 25 01:44:19.329082 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.329049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:19.558993 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.558881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:19.645770 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.645739    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" path="/var/lib/kubelet/pods/ee28ce82-a7ad-4c9c-95b9-62fa68953b0f/volumes"
Jul 25 01:44:19.856421 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.856373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:19.955186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:19.955151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:20.074841 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.074806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:20.372273 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.372234    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:44:20.372929 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.372903    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" containerName="payload-pre-processing"
Jul 25 01:44:20.373030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.372944    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" containerName="payload-pre-processing"
Jul 25 01:44:20.373030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.372975    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" containerName="revoke-keys"
Jul 25 01:44:20.373030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.372987    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" containerName="revoke-keys"
Jul 25 01:44:20.373030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.373006    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" containerName="payload-processing"
Jul 25 01:44:20.373030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.373015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" containerName="payload-processing"
Jul 25 01:44:20.373275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.373125    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="836b65f1-2d4c-4dcd-8ea5-e60d3dd6ff91" containerName="payload-processing"
Jul 25 01:44:20.373275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.373140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee28ce82-a7ad-4c9c-95b9-62fa68953b0f" containerName="revoke-keys"
Jul 25 01:44:20.373275 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.373155    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9c213f-a89e-4c1d-8392-52e025f0bbdc" containerName="payload-pre-processing"
Jul 25 01:44:20.378212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.378183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.380240 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.380211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-db7d7068-gw-openshift-default-dockercfg-tg4bv\""
Jul 25 01:44:20.386344 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.386292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:44:20.397104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.397058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:20.406769 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.406994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.406994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.406994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.406994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnvz4\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.406994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.406987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.407214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.407044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.407214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.407073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.407214 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.407131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508672 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508672 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.508965 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvz4\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.508989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.509113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.509232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509292 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.509254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509483 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.509458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.509645 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.509539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.511550 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.511495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.511665 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.511650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.516376 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.516345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.516521 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.516480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnvz4\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4\") pod \"e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") " pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.692093 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.691991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:20.850893 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.850863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:44:20.853852 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:44:20.853807    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742bf259_bc3f_4d8d_b023_5661566c0476.slice/crio-64bacafa397e0736ad9337dd77736feea08af508284aa8d38abb428a4623e4ac WatchSource:0}: Error finding container 64bacafa397e0736ad9337dd77736feea08af508284aa8d38abb428a4623e4ac: Status 404 returned error can't find the container with id 64bacafa397e0736ad9337dd77736feea08af508284aa8d38abb428a4623e4ac
Jul 25 01:44:20.856289 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.856256    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:20.856368 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.856330    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:20.856368 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.856359    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:20.870685 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.870617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:20.995647 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.995521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerStarted","Data":"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"}
Jul 25 01:44:20.995647 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:20.995611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerStarted","Data":"64bacafa397e0736ad9337dd77736feea08af508284aa8d38abb428a4623e4ac"}
Jul 25 01:44:21.015663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:21.014175    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podStartSLOduration=1.01415224 podStartE2EDuration="1.01415224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:44:21.012908134 +0000 UTC m=+1979.915553148" watchObservedRunningTime="2026-07-25 01:44:21.01415224 +0000 UTC m=+1979.916797253"
Jul 25 01:44:21.692535 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:21.692468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:21.697889 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:21.697859    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:22.001237 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:22.001141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:22.002212 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:22.002186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:22.461500 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:22.461460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:22.574242 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:22.574201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:22.770270 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:22.770176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:23.181918 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:23.181847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:23.281880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:23.281841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:44:24.585452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.585416    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:44:24.653859 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.653818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.653859 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.653859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.653902    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.653947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.653979    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz62q\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654126 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654129    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs\") pod \"d077413f-d115-4f22-b1aa-9482f24d5b1d\" (UID: \"d077413f-d115-4f22-b1aa-9482f24d5b1d\") "
Jul 25 01:44:24.654443 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654195    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:44:24.654585 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:44:24.654876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:44:24.654876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654749    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.654876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654772    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d077413f-d115-4f22-b1aa-9482f24d5b1d-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.654876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.654836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:44:24.656408 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.656371    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:44:24.657134 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.657045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:44:24.657134 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.657050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:44:24.657324 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.657183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:44:24.657547 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.657521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q" (OuterVolumeSpecName: "kube-api-access-pz62q") pod "d077413f-d115-4f22-b1aa-9482f24d5b1d" (UID: "d077413f-d115-4f22-b1aa-9482f24d5b1d"). InnerVolumeSpecName "kube-api-access-pz62q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:44:24.755669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755635    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755665    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755676    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz62q\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-kube-api-access-pz62q\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755934 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755685    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755934 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755693    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755934 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755700    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d077413f-d115-4f22-b1aa-9482f24d5b1d-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:24.755934 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:24.755708    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d077413f-d115-4f22-b1aa-9482f24d5b1d-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:44:25.018274 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.018175    2565 generic.go:356] "Generic (PLEG): container finished" podID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerID="11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690" exitCode=0
Jul 25 01:44:25.018274 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.018227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"
Jul 25 01:44:25.018274 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.018257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerDied","Data":"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"}
Jul 25 01:44:25.018546 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.018313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29" event={"ID":"d077413f-d115-4f22-b1aa-9482f24d5b1d","Type":"ContainerDied","Data":"41bd03e26224037859501244e71a30018c67a4225493ebd84d15be1d41b59e91"}
Jul 25 01:44:25.018546 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.018336    2565 scope.go:117] "RemoveContainer" containerID="11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"
Jul 25 01:44:25.028955 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.028928    2565 scope.go:117] "RemoveContainer" containerID="dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"
Jul 25 01:44:25.039023 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.038997    2565 scope.go:117] "RemoveContainer" containerID="11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"
Jul 25 01:44:25.039385 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:44:25.039361    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690\": container with ID starting with 11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690 not found: ID does not exist" containerID="11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"
Jul 25 01:44:25.039460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.039398    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690"} err="failed to get container status \"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690\": rpc error: code = NotFound desc = could not find container \"11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690\": container with ID starting with 11533601a213acd0d1012d53d6a82dc716302880d46ba3abea33cfa478482690 not found: ID does not exist"
Jul 25 01:44:25.039460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.039419    2565 scope.go:117] "RemoveContainer" containerID="dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"
Jul 25 01:44:25.039726 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:44:25.039708    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62\": container with ID starting with dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62 not found: ID does not exist" containerID="dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"
Jul 25 01:44:25.039793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.039729    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62"} err="failed to get container status \"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62\": rpc error: code = NotFound desc = could not find container \"dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62\": container with ID starting with dbdec8464ccc9037507f65bd90d83f367254acc8cf460aabcf05b3f8865f6c62 not found: ID does not exist"
Jul 25 01:44:25.040747 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.040722    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:44:25.044746 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.044716    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-04dad736-openshift-default-57bf845958-cgj29"]
Jul 25 01:44:25.646583 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:25.646539    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" path="/var/lib/kubelet/pods/d077413f-d115-4f22-b1aa-9482f24d5b1d/volumes"
Jul 25 01:44:37.510272 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:37.509328    2565 patch_prober.go:28] interesting pod/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:54084->10.134.0.41:15021: read: connection reset by peer" start-of-body=
Jul 25 01:44:37.510272 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:37.509402    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:54084->10.134.0.41:15021: read: connection reset by peer"
Jul 25 01:44:38.091893 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.091854    2565 generic.go:356] "Generic (PLEG): container finished" podID="742bf259-bc3f-4d8d-b023-5661566c0476" containerID="571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d" exitCode=0
Jul 25 01:44:38.092104 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.091929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerDied","Data":"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"}
Jul 25 01:44:38.092411 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.092395    2565 scope.go:117] "RemoveContainer" containerID="571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"
Jul 25 01:44:38.093865 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.093836    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:38.093988 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.093920    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:38.093988 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:38.093973    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:44:39.103782 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:39.103730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerStarted","Data":"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"}
Jul 25 01:44:39.693206 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:39.693160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:39.693451 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:39.693313    2565 patch_prober.go:28] interesting pod/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 25 01:44:39.693451 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:39.693362    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 25 01:44:40.692852 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:40.692799    2565 patch_prober.go:28] interesting pod/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 25 01:44:40.693391 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:40.692878    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 25 01:44:41.692671 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:41.692624    2565 patch_prober.go:28] interesting pod/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 25 01:44:41.693002 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:41.692969    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 25 01:44:42.692803 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:42.692761    2565 patch_prober.go:28] interesting pod/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 25 01:44:42.693178 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:42.693145    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 25 01:44:43.696238 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:43.696207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:43.696684 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:43.696584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:44:43.697354 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:44:43.697326    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:45:00.138380 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.138334    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"]
Jul 25 01:45:00.139004 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.138984    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.139057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.139008    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.139057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.139033    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.139057 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.139042    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.139163 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.139151    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.142743 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.142722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"]
Jul 25 01:45:00.142857 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.142838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"
Jul 25 01:45:00.143420 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.143388    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d077413f-d115-4f22-b1aa-9482f24d5b1d" containerName="istio-proxy"
Jul 25 01:45:00.145003 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.144872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:45:00.146662 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.146637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"
Jul 25 01:45:00.148528 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.148486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"]
Jul 25 01:45:00.151452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.151425    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"]
Jul 25 01:45:00.158774 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.158739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"
Jul 25 01:45:00.167542 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.166089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"
Jul 25 01:45:00.367686 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.367653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"]
Jul 25 01:45:00.369709 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:45:00.369679    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc235ed2c_b6c2_4a13_9ab1_18c2bb97776b.slice/crio-b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d WatchSource:0}: Error finding container b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d: Status 404 returned error can't find the container with id b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d
Jul 25 01:45:00.388851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:00.388663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"]
Jul 25 01:45:00.391104 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:45:00.391075    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f034755_1844_47e3_b117_89fad8619ef5.slice/crio-95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671 WatchSource:0}: Error finding container 95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671: Status 404 returned error can't find the container with id 95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671
Jul 25 01:45:01.234248 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.234202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7" event={"ID":"c235ed2c-b6c2-4a13-9ab1-18c2bb97776b","Type":"ContainerStarted","Data":"b84d9bcf2e3208948980a69d63bd3b66605e815c0de4ea65ace034effd32aab1"}
Jul 25 01:45:01.234769 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.234311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7" event={"ID":"c235ed2c-b6c2-4a13-9ab1-18c2bb97776b","Type":"ContainerStarted","Data":"b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d"}
Jul 25 01:45:01.235912 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.235879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv" event={"ID":"3f034755-1844-47e3-b117-89fad8619ef5","Type":"ContainerStarted","Data":"152336bae05c65b4210c50fa2363022213a88f6bccdd099124dadb151f38013a"}
Jul 25 01:45:01.236018 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.235938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv" event={"ID":"3f034755-1844-47e3-b117-89fad8619ef5","Type":"ContainerStarted","Data":"95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671"}
Jul 25 01:45:01.252462 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.252400    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7" podStartSLOduration=1.252382796 podStartE2EDuration="1.252382796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:45:01.249854162 +0000 UTC m=+2020.152499165" watchObservedRunningTime="2026-07-25 01:45:01.252382796 +0000 UTC m=+2020.155027808"
Jul 25 01:45:01.264221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:01.264153    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv" podStartSLOduration=1.264132318 podStartE2EDuration="1.264132318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:45:01.261435454 +0000 UTC m=+2020.164080467" watchObservedRunningTime="2026-07-25 01:45:01.264132318 +0000 UTC m=+2020.166777361"
Jul 25 01:45:02.242698 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:02.242656    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f034755-1844-47e3-b117-89fad8619ef5" containerID="152336bae05c65b4210c50fa2363022213a88f6bccdd099124dadb151f38013a" exitCode=0
Jul 25 01:45:02.243221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:02.242739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv" event={"ID":"3f034755-1844-47e3-b117-89fad8619ef5","Type":"ContainerDied","Data":"152336bae05c65b4210c50fa2363022213a88f6bccdd099124dadb151f38013a"}
Jul 25 01:45:02.244371 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:02.244337    2565 generic.go:356] "Generic (PLEG): container finished" podID="c235ed2c-b6c2-4a13-9ab1-18c2bb97776b" containerID="b84d9bcf2e3208948980a69d63bd3b66605e815c0de4ea65ace034effd32aab1" exitCode=0
Jul 25 01:45:02.244487 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:02.244395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7" event={"ID":"c235ed2c-b6c2-4a13-9ab1-18c2bb97776b","Type":"ContainerDied","Data":"b84d9bcf2e3208948980a69d63bd3b66605e815c0de4ea65ace034effd32aab1"}
Jul 25 01:45:03.404593 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:03.404566    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"
Jul 25 01:45:03.426495 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:03.426465    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"
Jul 25 01:45:04.257817 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.257785    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"
Jul 25 01:45:04.258058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.257820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7" event={"ID":"c235ed2c-b6c2-4a13-9ab1-18c2bb97776b","Type":"ContainerDied","Data":"b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d"}
Jul 25 01:45:04.258058 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.257889    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b08cd1e9dbf4e4bf702abc1d980b9e81f82fbb94921f988ab6a229ca110e891d"
Jul 25 01:45:04.259366 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.259337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv" event={"ID":"3f034755-1844-47e3-b117-89fad8619ef5","Type":"ContainerDied","Data":"95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671"}
Jul 25 01:45:04.259481 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.259392    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a8b0badfc0eca7817caecb164d90ef889bb4b8b481b657a3c562c2df44c671"
Jul 25 01:45:04.259481 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:04.259350    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749065-qn8nv"
Jul 25 01:45:06.782491 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:45:06.782457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:20.992250 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:20.992162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:22.189167 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:22.189130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:31.210305 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210269    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"]
Jul 25 01:47:31.210818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210732    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f034755-1844-47e3-b117-89fad8619ef5" containerName="cleanup"
Jul 25 01:47:31.210818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210745    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f034755-1844-47e3-b117-89fad8619ef5" containerName="cleanup"
Jul 25 01:47:31.210818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210764    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c235ed2c-b6c2-4a13-9ab1-18c2bb97776b" containerName="cleanup"
Jul 25 01:47:31.210818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210770    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c235ed2c-b6c2-4a13-9ab1-18c2bb97776b" containerName="cleanup"
Jul 25 01:47:31.210954 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210848    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f034755-1844-47e3-b117-89fad8619ef5" containerName="cleanup"
Jul 25 01:47:31.210954 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.210857    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c235ed2c-b6c2-4a13-9ab1-18c2bb97776b" containerName="cleanup"
Jul 25 01:47:31.214096 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.214076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:31.216130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.216102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:47:31.216297 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.216115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 01:47:31.226994 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.226965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"]
Jul 25 01:47:31.310883 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.310837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql\" (UID: \"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:31.412491 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.412446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql\" (UID: \"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:31.413153 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.413122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql\" (UID: \"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:31.525673 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.525546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:31.683914 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:31.683882    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"]
Jul 25 01:47:31.686715 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:47:31.686682    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed2a5dc_0400_4eca_8ad0_aa6553b47aac.slice/crio-9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168 WatchSource:0}: Error finding container 9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168: Status 404 returned error can't find the container with id 9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168
Jul 25 01:47:32.066131 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:32.066091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql" event={"ID":"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac","Type":"ContainerStarted","Data":"ed31f4260ae6508726cdd0c3c22869bab795d1be776488f83ae7ddeefd071006"}
Jul 25 01:47:32.066331 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:32.066148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql" event={"ID":"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac","Type":"ContainerStarted","Data":"9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168"}
Jul 25 01:47:32.083219 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:32.083157    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql" podStartSLOduration=1.083136697 podStartE2EDuration="1.083136697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:47:32.080444132 +0000 UTC m=+2170.983089143" watchObservedRunningTime="2026-07-25 01:47:32.083136697 +0000 UTC m=+2170.985781709"
Jul 25 01:47:33.073654 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:33.073613    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" containerID="ed31f4260ae6508726cdd0c3c22869bab795d1be776488f83ae7ddeefd071006" exitCode=0
Jul 25 01:47:33.074034 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:33.073698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql" event={"ID":"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac","Type":"ContainerDied","Data":"ed31f4260ae6508726cdd0c3c22869bab795d1be776488f83ae7ddeefd071006"}
Jul 25 01:47:34.219901 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:34.219863    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:34.344826 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:34.344785    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca\") pod \"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac\" (UID: \"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac\") "
Jul 25 01:47:34.345170 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:34.345148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" (UID: "1ed2a5dc-0400-4eca-8ad0-aa6553b47aac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:47:34.445654 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:34.445612    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:35.085700 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:35.085669    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"
Jul 25 01:47:35.085911 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:35.085668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql" event={"ID":"1ed2a5dc-0400-4eca-8ad0-aa6553b47aac","Type":"ContainerDied","Data":"9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168"}
Jul 25 01:47:35.085911 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:35.085801    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9628a7d077c15df57779e252a6d1baca58d33e5a886c12f4b1077775cb05e168"
Jul 25 01:47:41.653484 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:41.653442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:41.655446 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:41.655278    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"]
Jul 25 01:47:41.657669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:41.657644    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-db7d7068-29749065-fbbv7"]
Jul 25 01:47:41.718963 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:41.718926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:41.778793 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:41.778752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:43.646114 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:43.646076    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c235ed2c-b6c2-4a13-9ab1-18c2bb97776b" path="/var/lib/kubelet/pods/c235ed2c-b6c2-4a13-9ab1-18c2bb97776b/volumes"
Jul 25 01:47:46.274833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.274802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:46.294426 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.294389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"]
Jul 25 01:47:46.296503 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.296479    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-db7d7068-cvsql"]
Jul 25 01:47:46.431048 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.431009    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:47:46.431847 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.431799    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy" containerID="cri-o://e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb" gracePeriod=30
Jul 25 01:47:46.452291 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.452257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:46.676705 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.676672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:46.926689 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:46.926656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:47.218095 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.218054    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:47:47.218797 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.218768    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" containerName="revoke-keys"
Jul 25 01:47:47.218797 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.218794    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" containerName="revoke-keys"
Jul 25 01:47:47.218989 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.218873    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" containerName="revoke-keys"
Jul 25 01:47:47.222431 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.222403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.224371 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.224345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9f2c0ee3-openshift-default-dockercfg-nbfbf\""
Jul 25 01:47:47.233781 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.233745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:47:47.245111 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.245078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:47.274180 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274405 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsckg\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274405 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274405 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274756 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.274756 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.274734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.358101 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.358061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:47.376393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsckg\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376393 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376845 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376845 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.376845 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377025 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377025 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.376961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377392 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.377351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377392 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.377388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.377426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.377625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.377457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.379268 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.379232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.379490 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.379471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.383812 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.383777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.384078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.384055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsckg\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg\") pod \"e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") " pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.535905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.535799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:47.649829 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.649779    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed2a5dc-0400-4eca-8ad0-aa6553b47aac" path="/var/lib/kubelet/pods/1ed2a5dc-0400-4eca-8ad0-aa6553b47aac/volumes"
Jul 25 01:47:47.691079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.691044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:47:47.693642 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:47:47.693613    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546abbfc_c9eb_4b1c_bf66_66b671f14cc9.slice/crio-75d96f09bf751b578b50db8d92250ead1c9d89d3a471c50f7bf8a5c65eb3e946 WatchSource:0}: Error finding container 75d96f09bf751b578b50db8d92250ead1c9d89d3a471c50f7bf8a5c65eb3e946: Status 404 returned error can't find the container with id 75d96f09bf751b578b50db8d92250ead1c9d89d3a471c50f7bf8a5c65eb3e946
Jul 25 01:47:47.696400 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.696368    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:47:47.696542 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.696455    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:47:47.696542 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:47.696503    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:47:48.160228 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:48.160187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerStarted","Data":"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"}
Jul 25 01:47:48.160451 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:48.160295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerStarted","Data":"75d96f09bf751b578b50db8d92250ead1c9d89d3a471c50f7bf8a5c65eb3e946"}
Jul 25 01:47:48.199310 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:48.199239    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podStartSLOduration=1.199214058 podStartE2EDuration="1.199214058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:47:48.197670112 +0000 UTC m=+2187.100315147" watchObservedRunningTime="2026-07-25 01:47:48.199214058 +0000 UTC m=+2187.101859070"
Jul 25 01:47:48.536108 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:48.536013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:48.541585 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:48.541552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:49.166043 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:49.166008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:49.167030 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:49.166997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:47:49.533327 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:49.533222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:49.626646 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:49.626604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:49.692669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:49.692637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:50.208042 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:50.207994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:50.318769 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:50.318730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:47:51.702777 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.702703    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:47:51.825896 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.825855    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnvz4\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.825911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.825952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.825987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826061    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826098 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826315 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826315 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826315 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826226    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket\") pod \"742bf259-bc3f-4d8d-b023-5661566c0476\" (UID: \"742bf259-bc3f-4d8d-b023-5661566c0476\") "
Jul 25 01:47:51.826315 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:47:51.826575 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826381    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:47:51.826832 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:47:51.826943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826834    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.826943 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826856    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.827035 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.826948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:47:51.827077 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.827022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data" (OuterVolumeSpecName: "istio-data") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:47:51.828837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.828798    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4" (OuterVolumeSpecName: "kube-api-access-fnvz4") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "kube-api-access-fnvz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:47:51.829002 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.828941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token" (OuterVolumeSpecName: "istio-token") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:47:51.829120 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.829101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:47:51.830218 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.830198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "742bf259-bc3f-4d8d-b023-5661566c0476" (UID: "742bf259-bc3f-4d8d-b023-5661566c0476"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:47:51.928137 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928095    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928137 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928129    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928137 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928138    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/742bf259-bc3f-4d8d-b023-5661566c0476-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928415 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928147    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928415 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928167    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnvz4\" (UniqueName: \"kubernetes.io/projected/742bf259-bc3f-4d8d-b023-5661566c0476-kube-api-access-fnvz4\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928415 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928177    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/742bf259-bc3f-4d8d-b023-5661566c0476-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:51.928415 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:51.928185    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/742bf259-bc3f-4d8d-b023-5661566c0476-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:47:52.185381 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.185340    2565 generic.go:356] "Generic (PLEG): container finished" podID="742bf259-bc3f-4d8d-b023-5661566c0476" containerID="e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb" exitCode=0
Jul 25 01:47:52.185625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.185409    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"
Jul 25 01:47:52.185625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.185420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerDied","Data":"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"}
Jul 25 01:47:52.185625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.185538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x" event={"ID":"742bf259-bc3f-4d8d-b023-5661566c0476","Type":"ContainerDied","Data":"64bacafa397e0736ad9337dd77736feea08af508284aa8d38abb428a4623e4ac"}
Jul 25 01:47:52.185625 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.185574    2565 scope.go:117] "RemoveContainer" containerID="e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"
Jul 25 01:47:52.196161 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.196139    2565 scope.go:117] "RemoveContainer" containerID="571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"
Jul 25 01:47:52.206019 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.205986    2565 scope.go:117] "RemoveContainer" containerID="e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"
Jul 25 01:47:52.206819 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:47:52.206651    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb\": container with ID starting with e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb not found: ID does not exist" containerID="e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"
Jul 25 01:47:52.206819 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.206700    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb"} err="failed to get container status \"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb\": rpc error: code = NotFound desc = could not find container \"e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb\": container with ID starting with e306b0a7b2df3a6900caff5d29ddea42cd7c67e99e5cb7819685da348e0aa2cb not found: ID does not exist"
Jul 25 01:47:52.206819 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.206728    2565 scope.go:117] "RemoveContainer" containerID="571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"
Jul 25 01:47:52.207157 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:47:52.207095    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d\": container with ID starting with 571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d not found: ID does not exist" containerID="571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"
Jul 25 01:47:52.207157 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.207132    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d"} err="failed to get container status \"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d\": rpc error: code = NotFound desc = could not find container \"571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d\": container with ID starting with 571a08f1381ca90e2da5fde2d4e295fac949af0b7a90d0252830ce94d51d455d not found: ID does not exist"
Jul 25 01:47:52.208186 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.208165    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:47:52.210353 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:52.210323    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-db7d7068-gw-openshift-default-ff96bd748-xmh8x"]
Jul 25 01:47:53.645928 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:47:53.645888    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" path="/var/lib/kubelet/pods/742bf259-bc3f-4d8d-b023-5661566c0476/volumes"
Jul 25 01:48:04.700361 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:04.699490    2565 patch_prober.go:28] interesting pod/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:54698->10.134.0.45:15021: read: connection reset by peer" start-of-body=
Jul 25 01:48:04.700361 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:04.699601    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:54698->10.134.0.45:15021: read: connection reset by peer"
Jul 25 01:48:05.266012 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.265977    2565 generic.go:356] "Generic (PLEG): container finished" podID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerID="2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889" exitCode=0
Jul 25 01:48:05.266337 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.266045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerDied","Data":"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"}
Jul 25 01:48:05.266521 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.266495    2565 scope.go:117] "RemoveContainer" containerID="2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"
Jul 25 01:48:05.267678 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.267648    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:48:05.267804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.267733    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:48:05.267804 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:05.267778    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:48:06.273833 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:06.273791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerStarted","Data":"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"}
Jul 25 01:48:06.536385 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:06.536262    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:48:06.536629 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:06.536595    2565 patch_prober.go:28] interesting pod/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 25 01:48:06.536718 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:06.536670    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 25 01:48:07.537024 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:07.536978    2565 patch_prober.go:28] interesting pod/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 25 01:48:07.537452 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:07.537058    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 25 01:48:08.536886 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:08.536842    2565 patch_prober.go:28] interesting pod/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 25 01:48:08.537097 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:08.536928    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 25 01:48:09.537074 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:09.537030    2565 patch_prober.go:28] interesting pod/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 25 01:48:09.537282 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:09.537093    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 25 01:48:10.539790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:10.539750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:48:10.540221 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:10.540146    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:48:10.540958 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:48:10.540939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:49:32.642382 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:49:32.642343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:50:21.840604 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:50:21.840488    2565 scope.go:117] "RemoveContainer" containerID="f7a1da974b1f4135ba6901260ef52c2b82891811e269672b0132722d11f203c0"
Jul 25 01:51:21.862809 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:51:21.862769    2565 scope.go:117] "RemoveContainer" containerID="b84d9bcf2e3208948980a69d63bd3b66605e815c0de4ea65ace034effd32aab1"
Jul 25 01:52:56.250598 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.250557    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"]
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.250982    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.250995    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.251014    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.251020    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.251096    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.251118 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.251106    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="742bf259-bc3f-4d8d-b023-5661566c0476" containerName="istio-proxy"
Jul 25 01:52:56.254288 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.254262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:56.256488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.256455    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:52:56.256669 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.256615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 01:52:56.272150 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.272100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"]
Jul 25 01:52:56.378209 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.378166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2\" (UID: \"865debef-d388-41e8-8990-107657b9e7ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:56.479019 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.478965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2\" (UID: \"865debef-d388-41e8-8990-107657b9e7ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:56.479731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.479712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2\" (UID: \"865debef-d388-41e8-8990-107657b9e7ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:56.567579 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.567454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:56.720472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.720442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"]
Jul 25 01:52:56.851068 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:56.851025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2" event={"ID":"865debef-d388-41e8-8990-107657b9e7ec","Type":"ContainerStarted","Data":"d0d94e3ec643bf9911093088dad7204eb3563198dd729caff3030a1284275df0"}
Jul 25 01:52:57.857972 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:57.857938    2565 generic.go:356] "Generic (PLEG): container finished" podID="865debef-d388-41e8-8990-107657b9e7ec" containerID="016dd69b7ea9781aebf3d263f8aae9858d2d2f9f4ebf89617ef03a4baebffd4d" exitCode=0
Jul 25 01:52:57.858425 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:57.858033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2" event={"ID":"865debef-d388-41e8-8990-107657b9e7ec","Type":"ContainerDied","Data":"016dd69b7ea9781aebf3d263f8aae9858d2d2f9f4ebf89617ef03a4baebffd4d"}
Jul 25 01:52:59.011668 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.011643    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:59.101959 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.101924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca\") pod \"865debef-d388-41e8-8990-107657b9e7ec\" (UID: \"865debef-d388-41e8-8990-107657b9e7ec\") "
Jul 25 01:52:59.102316 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.102291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "865debef-d388-41e8-8990-107657b9e7ec" (UID: "865debef-d388-41e8-8990-107657b9e7ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:52:59.203546 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.203413    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/865debef-d388-41e8-8990-107657b9e7ec-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:52:59.871714 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.871688    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"
Jul 25 01:52:59.871905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.871730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2" event={"ID":"865debef-d388-41e8-8990-107657b9e7ec","Type":"ContainerDied","Data":"d0d94e3ec643bf9911093088dad7204eb3563198dd729caff3030a1284275df0"}
Jul 25 01:52:59.871905 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:52:59.871782    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d94e3ec643bf9911093088dad7204eb3563198dd729caff3030a1284275df0"
Jul 25 01:53:06.767051 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:06.767005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:07.858042 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:07.857994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:11.311450 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.311417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:11.327641 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.327599    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"]
Jul 25 01:53:11.329702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.329674    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f2c0ee3-jz8k2"]
Jul 25 01:53:11.459849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.459815    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:53:11.460111 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.460082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy" containerID="cri-o://1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8" gracePeriod=30
Jul 25 01:53:11.481628 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.481597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:11.645998 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.645963    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865debef-d388-41e8-8990-107657b9e7ec" path="/var/lib/kubelet/pods/865debef-d388-41e8-8990-107657b9e7ec/volumes"
Jul 25 01:53:11.730099 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.730062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:11.996284 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:11.996184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:12.268854 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.268753    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:53:12.269460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.269431    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865debef-d388-41e8-8990-107657b9e7ec" containerName="revoke-keys"
Jul 25 01:53:12.269460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.269461    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="865debef-d388-41e8-8990-107657b9e7ec" containerName="revoke-keys"
Jul 25 01:53:12.269689 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.269594    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="865debef-d388-41e8-8990-107657b9e7ec" containerName="revoke-keys"
Jul 25 01:53:12.273073 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.273051    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.275196 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.275173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ed0d590f-openshift-default-dockercfg-9pllb\""
Jul 25 01:53:12.283731 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.283704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:53:12.296492 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.296451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:12.337129 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqmr\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.337695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.337460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.410925 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.410883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:12.438849 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.438807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439060 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.438865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439060 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.438893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439060 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.438915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqmr\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439060 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.438935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439279 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439567 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439567 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439691 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439752 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.439997 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.439972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.441312 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.441283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.441616 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.441600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.446316 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.446284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqmr\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.446663 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.446642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token\") pod \"e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") " pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.585917 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.585866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:12.742563 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.742536    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:53:12.745458 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:53:12.745429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294936c7_3ee1_4393_8d4f_220e5f2b8307.slice/crio-2c38a03c4be56b44a597054d6b3d974f8715e1f4392bb42c9fb767d46cff4615 WatchSource:0}: Error finding container 2c38a03c4be56b44a597054d6b3d974f8715e1f4392bb42c9fb767d46cff4615: Status 404 returned error can't find the container with id 2c38a03c4be56b44a597054d6b3d974f8715e1f4392bb42c9fb767d46cff4615
Jul 25 01:53:12.747818 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.747781    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:12.747936 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.747871    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:12.747936 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.747925    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:12.942854 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.942723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerStarted","Data":"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"}
Jul 25 01:53:12.942854 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.942818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerStarted","Data":"2c38a03c4be56b44a597054d6b3d974f8715e1f4392bb42c9fb767d46cff4615"}
Jul 25 01:53:12.961861 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:12.961805    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podStartSLOduration=0.96178522 podStartE2EDuration="961.78522ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:53:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:53:12.959381667 +0000 UTC m=+2511.862026693" watchObservedRunningTime="2026-07-25 01:53:12.96178522 +0000 UTC m=+2511.864430232"
Jul 25 01:53:13.587141 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:13.587090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:13.592692 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:13.592661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:13.948552 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:13.948428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:13.949594 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:13.949572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:14.292460 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.292347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:14.373785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.373748    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:14.443188 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.443150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:14.787309 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.787273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:14.892217 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.892153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:14.987462 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:14.987422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:53:15.053576 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.053460    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:53:15.057334 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.057314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.059499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.059473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ed0d590f\""
Jul 25 01:53:15.059499 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.059498    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ed0d590f-dockercfg-hhtn7\""
Jul 25 01:53:15.072997 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.072727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:53:15.171828 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.171779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.171828 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.171838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbvw\" (UniqueName: \"kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.272892 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.272847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.272892 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.272901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbvw\" (UniqueName: \"kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.273710 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.273685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.280222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.280189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbvw\" (UniqueName: \"kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw\") pod \"payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.378696 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.378654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.530534 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.530473    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:53:15.532901 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:53:15.532864    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb83831_a4a0_4fd1_bb35_2e9402a0c4ac.slice/crio-face6fbbdd3647b91bfe31cbe08482a49ee289d64fa2ad0f2b0d87deed6e99eb WatchSource:0}: Error finding container face6fbbdd3647b91bfe31cbe08482a49ee289d64fa2ad0f2b0d87deed6e99eb: Status 404 returned error can't find the container with id face6fbbdd3647b91bfe31cbe08482a49ee289d64fa2ad0f2b0d87deed6e99eb
Jul 25 01:53:15.961516 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.961461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" event={"ID":"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac","Type":"ContainerStarted","Data":"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"}
Jul 25 01:53:15.961938 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.961747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:15.961938 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.961786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" event={"ID":"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac","Type":"ContainerStarted","Data":"face6fbbdd3647b91bfe31cbe08482a49ee289d64fa2ad0f2b0d87deed6e99eb"}
Jul 25 01:53:15.976785 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:15.976694    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" podStartSLOduration=0.976673708 podStartE2EDuration="976.673708ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:53:15.975320937 +0000 UTC m=+2514.877965952" watchObservedRunningTime="2026-07-25 01:53:15.976673708 +0000 UTC m=+2514.879318739"
Jul 25 01:53:16.724130 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.724043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:53:16.792145 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsckg\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792432 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792488 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792589 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792589 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792639    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token\") pod \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\" (UID: \"546abbfc-c9eb-4b1c-bf66-66b671f14cc9\") "
Jul 25 01:53:16.792702 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:53:16.792852 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:53:16.792852 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:53:16.793019 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.792991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:53:16.793116 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.793102    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.793182 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.793123    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.793182 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.793136    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.793182 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.793149    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.793347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.793314    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data" (OuterVolumeSpecName: "istio-data") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:53:16.795088 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.795061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:53:16.795222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.795131    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token" (OuterVolumeSpecName: "istio-token") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:53:16.795222 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.795162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg" (OuterVolumeSpecName: "kube-api-access-rsckg") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "kube-api-access-rsckg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:53:16.795343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.795308    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "546abbfc-c9eb-4b1c-bf66-66b671f14cc9" (UID: "546abbfc-c9eb-4b1c-bf66-66b671f14cc9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:53:16.894183 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.894130    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.894183 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.894171    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.894183 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.894183    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsckg\" (UniqueName: \"kubernetes.io/projected/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-kube-api-access-rsckg\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.894183 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.894192    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.894476 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.894202    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/546abbfc-c9eb-4b1c-bf66-66b671f14cc9-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:53:16.968637 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.968605    2565 generic.go:356] "Generic (PLEG): container finished" podID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerID="1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8" exitCode=0
Jul 25 01:53:16.969151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.968668    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"
Jul 25 01:53:16.969151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.968694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerDied","Data":"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"}
Jul 25 01:53:16.969151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.968751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg" event={"ID":"546abbfc-c9eb-4b1c-bf66-66b671f14cc9","Type":"ContainerDied","Data":"75d96f09bf751b578b50db8d92250ead1c9d89d3a471c50f7bf8a5c65eb3e946"}
Jul 25 01:53:16.969151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.968774    2565 scope.go:117] "RemoveContainer" containerID="1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"
Jul 25 01:53:16.979644 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.979620    2565 scope.go:117] "RemoveContainer" containerID="2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"
Jul 25 01:53:16.989808 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.989778    2565 scope.go:117] "RemoveContainer" containerID="1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"
Jul 25 01:53:16.990180 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:53:16.990156    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8\": container with ID starting with 1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8 not found: ID does not exist" containerID="1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"
Jul 25 01:53:16.990260 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.990195    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8"} err="failed to get container status \"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8\": rpc error: code = NotFound desc = could not find container \"1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8\": container with ID starting with 1c377c7dce22bd4b93567abc6e773f7173a2d2ab38454b5c48a457f2b9eb66d8 not found: ID does not exist"
Jul 25 01:53:16.990260 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.990222    2565 scope.go:117] "RemoveContainer" containerID="2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"
Jul 25 01:53:16.990486 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:53:16.990466    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889\": container with ID starting with 2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889 not found: ID does not exist" containerID="2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"
Jul 25 01:53:16.990570 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.990491    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889"} err="failed to get container status \"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889\": rpc error: code = NotFound desc = could not find container \"2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889\": container with ID starting with 2132e3d9abe380d26fb1d07cd1c03cb942abf0ff3d0ac05d7c4cb3e904f47889 not found: ID does not exist"
Jul 25 01:53:16.991329 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.991307    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:53:16.995020 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:16.994994    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9f2c0ee3-openshift-default-649866b4f8-lnqlg"]
Jul 25 01:53:17.646444 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:17.646399    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" path="/var/lib/kubelet/pods/546abbfc-c9eb-4b1c-bf66-66b671f14cc9/volumes"
Jul 25 01:53:26.972008 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:26.971965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:53:29.112213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:29.110930    2565 patch_prober.go:28] interesting pod/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:46260->10.134.0.47:15021: read: connection reset by peer" start-of-body=
Jul 25 01:53:29.112213 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:29.111016    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:46260->10.134.0.47:15021: read: connection reset by peer"
Jul 25 01:53:30.041930 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.041893    2565 generic.go:356] "Generic (PLEG): container finished" podID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerID="1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d" exitCode=0
Jul 25 01:53:30.042122 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.041964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerDied","Data":"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"}
Jul 25 01:53:30.042423 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.042410    2565 scope.go:117] "RemoveContainer" containerID="1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"
Jul 25 01:53:30.043622 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.043595    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:30.043699 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.043666    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:30.043737 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:30.043699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:53:31.049735 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:31.049692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerStarted","Data":"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"}
Jul 25 01:53:31.586875 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:31.586831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:31.587115 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:31.586979    2565 patch_prober.go:28] interesting pod/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:53:31.587115 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:31.587038    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 25 01:53:32.586600 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:32.586549    2565 patch_prober.go:28] interesting pod/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:53:32.587142 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:32.586626    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 25 01:53:33.586790 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:33.586747    2565 patch_prober.go:28] interesting pod/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:53:33.587474 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:33.587434    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 25 01:53:34.588176 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:34.588122    2565 patch_prober.go:28] interesting pod/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:53:34.588792 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:34.588200    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 25 01:53:35.590805 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:35.590763    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:35.591200 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:35.591056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:35.591811 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:35.591796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:53:46.989900 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:53:46.989860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:54:21.908771 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:54:21.908736    2565 scope.go:117] "RemoveContainer" containerID="ed31f4260ae6508726cdd0c3c22869bab795d1be776488f83ae7ddeefd071006"
Jul 25 01:55:23.697596 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:55:23.697563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:55:34.550582 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:55:34.550535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:55:34.978591 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:55:34.978553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:57:47.676501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:57:47.676395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:20.713372 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713338    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"]
Jul 25 01:58:20.713880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713818    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 01:58:20.713880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713831    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 01:58:20.713880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713846    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 01:58:20.713880 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713851    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 01:58:20.714017 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.713914    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 01:58:20.717266 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.717231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:20.719158 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.719130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 01:58:20.719298 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.719191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 01:58:20.729567 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.729537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"]
Jul 25 01:58:20.771332 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.771284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9\" (UID: \"c5359f27-303e-4137-b2ae-7a5b08132ec1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:20.872297 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.872251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9\" (UID: \"c5359f27-303e-4137-b2ae-7a5b08132ec1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:20.872945 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:20.872925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9\" (UID: \"c5359f27-303e-4137-b2ae-7a5b08132ec1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:21.028516 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:21.028407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:21.173981 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:21.173953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"]
Jul 25 01:58:21.176678 ip-10-0-130-23 kubenswrapper[2565]: W0725 01:58:21.176642    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5359f27_303e_4137_b2ae_7a5b08132ec1.slice/crio-1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf WatchSource:0}: Error finding container 1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf: Status 404 returned error can't find the container with id 1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf
Jul 25 01:58:21.621657 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:21.621622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9" event={"ID":"c5359f27-303e-4137-b2ae-7a5b08132ec1","Type":"ContainerStarted","Data":"bb4a28981f99bd40172cf3afd12c64a9bd6f27da3a18614569d61a6abef3c22b"}
Jul 25 01:58:21.621837 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:21.621678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9" event={"ID":"c5359f27-303e-4137-b2ae-7a5b08132ec1","Type":"ContainerStarted","Data":"1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf"}
Jul 25 01:58:21.638002 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:21.637940    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9" podStartSLOduration=1.637921506 podStartE2EDuration="1.637921506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:58:21.635171309 +0000 UTC m=+2820.537816321" watchObservedRunningTime="2026-07-25 01:58:21.637921506 +0000 UTC m=+2820.540566517"
Jul 25 01:58:22.628730 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:22.628690    2565 generic.go:356] "Generic (PLEG): container finished" podID="c5359f27-303e-4137-b2ae-7a5b08132ec1" containerID="bb4a28981f99bd40172cf3afd12c64a9bd6f27da3a18614569d61a6abef3c22b" exitCode=0
Jul 25 01:58:22.629188 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:22.628774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9" event={"ID":"c5359f27-303e-4137-b2ae-7a5b08132ec1","Type":"ContainerDied","Data":"bb4a28981f99bd40172cf3afd12c64a9bd6f27da3a18614569d61a6abef3c22b"}
Jul 25 01:58:23.772520 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:23.772484    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:23.805941 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:23.805906    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca\") pod \"c5359f27-303e-4137-b2ae-7a5b08132ec1\" (UID: \"c5359f27-303e-4137-b2ae-7a5b08132ec1\") "
Jul 25 01:58:23.806307 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:23.806284    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5359f27-303e-4137-b2ae-7a5b08132ec1" (UID: "c5359f27-303e-4137-b2ae-7a5b08132ec1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:58:23.907078 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:23.906977    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5359f27-303e-4137-b2ae-7a5b08132ec1-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:24.640419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:24.640387    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"
Jul 25 01:58:24.640650 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:24.640428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9" event={"ID":"c5359f27-303e-4137-b2ae-7a5b08132ec1","Type":"ContainerDied","Data":"1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf"}
Jul 25 01:58:24.640650 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:24.640483    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1be6155d92861fe4ca26b9c8763024687daa78cc02f4729aa97565b53583cabf"
Jul 25 01:58:31.135289 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.135245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:31.171975 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.171938    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:58:31.172470 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.172208    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" podUID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" containerName="payload-pre-processing" containerID="cri-o://4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf" gracePeriod=30
Jul 25 01:58:31.457710 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.457412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:58:31.586111 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.586075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume\") pod \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") "
Jul 25 01:58:31.586267 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.586170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmbvw\" (UniqueName: \"kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw\") pod \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\" (UID: \"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac\") "
Jul 25 01:58:31.586444 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.586420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" (UID: "cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:58:31.588267 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.588233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw" (OuterVolumeSpecName: "kube-api-access-vmbvw") pod "cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" (UID: "cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac"). InnerVolumeSpecName "kube-api-access-vmbvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:58:31.677855 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.677816    2565 generic.go:356] "Generic (PLEG): container finished" podID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" containerID="4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf" exitCode=0
Jul 25 01:58:31.678079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.677866    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"
Jul 25 01:58:31.678079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.677911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" event={"ID":"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac","Type":"ContainerDied","Data":"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"}
Jul 25 01:58:31.678079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.677981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz" event={"ID":"cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac","Type":"ContainerDied","Data":"face6fbbdd3647b91bfe31cbe08482a49ee289d64fa2ad0f2b0d87deed6e99eb"}
Jul 25 01:58:31.678079 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.678012    2565 scope.go:117] "RemoveContainer" containerID="4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"
Jul 25 01:58:31.687326 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.687305    2565 scope.go:117] "RemoveContainer" containerID="4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"
Jul 25 01:58:31.687663 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:58:31.687642    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf\": container with ID starting with 4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf not found: ID does not exist" containerID="4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"
Jul 25 01:58:31.687732 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.687673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf"} err="failed to get container status \"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf\": rpc error: code = NotFound desc = could not find container \"4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf\": container with ID starting with 4ac5e46160892f6caf7a3e8bf9701d09227b3d8e067e64b0f2534a0b55fd4acf not found: ID does not exist"
Jul 25 01:58:31.687813 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.687795    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:31.687851 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.687819    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmbvw\" (UniqueName: \"kubernetes.io/projected/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac-kube-api-access-vmbvw\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:31.692782 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.692753    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:58:31.699301 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:31.699266    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed0d590f-57c8f5fc4d-7szdz"]
Jul 25 01:58:32.230922 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:32.230883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:33.653437 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:33.653395    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" path="/var/lib/kubelet/pods/cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac/volumes"
Jul 25 01:58:35.773364 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.773331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:35.838315 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.838282    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"]
Jul 25 01:58:35.845881 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.845848    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ed0d590f-4z9x9"]
Jul 25 01:58:35.956036 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.956002    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:58:35.956294 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.956255    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy" containerID="cri-o://497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241" gracePeriod=30
Jul 25 01:58:35.978392 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:35.978351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:36.195629 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:36.195593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:36.668309 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:36.668273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:36.768340 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:36.768302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:36.868881 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:36.868843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:37.645841 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:37.645806    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5359f27-303e-4137-b2ae-7a5b08132ec1" path="/var/lib/kubelet/pods/c5359f27-303e-4137-b2ae-7a5b08132ec1/volumes"
Jul 25 01:58:38.237540 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:38.237477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:41.227897 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.227824    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:58:41.397217 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397340    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397419 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vqmr\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397445    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs\") pod \"294936c7-3ee1-4393-8d4f-220e5f2b8307\" (UID: \"294936c7-3ee1-4393-8d4f-220e5f2b8307\") "
Jul 25 01:58:41.397848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397773    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:58:41.397848 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:58:41.398003 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.397946    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:58:41.398107 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.398079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:58:41.398347 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.398320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data" (OuterVolumeSpecName: "istio-data") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:58:41.399723 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.399672    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token" (OuterVolumeSpecName: "istio-token") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:58:41.399723 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.399718    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:58:41.399876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.399770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr" (OuterVolumeSpecName: "kube-api-access-7vqmr") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "kube-api-access-7vqmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:58:41.399876 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.399771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "294936c7-3ee1-4393-8d4f-220e5f2b8307" (UID: "294936c7-3ee1-4393-8d4f-220e5f2b8307"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498694    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498730    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498738    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294936c7-3ee1-4393-8d4f-220e5f2b8307-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498746    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498755    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498763    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498770    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498781    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vqmr\" (UniqueName: \"kubernetes.io/projected/294936c7-3ee1-4393-8d4f-220e5f2b8307-kube-api-access-7vqmr\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.498800 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.498789    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294936c7-3ee1-4393-8d4f-220e5f2b8307-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 01:58:41.734059 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.734021    2565 generic.go:356] "Generic (PLEG): container finished" podID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerID="497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241" exitCode=0
Jul 25 01:58:41.734262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.734063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerDied","Data":"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"}
Jul 25 01:58:41.734262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.734094    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"
Jul 25 01:58:41.734262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.734124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq" event={"ID":"294936c7-3ee1-4393-8d4f-220e5f2b8307","Type":"ContainerDied","Data":"2c38a03c4be56b44a597054d6b3d974f8715e1f4392bb42c9fb767d46cff4615"}
Jul 25 01:58:41.734262 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.734149    2565 scope.go:117] "RemoveContainer" containerID="497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"
Jul 25 01:58:41.743665 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.743645    2565 scope.go:117] "RemoveContainer" containerID="1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"
Jul 25 01:58:41.750178 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.750109    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:58:41.753697 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.753675    2565 scope.go:117] "RemoveContainer" containerID="497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"
Jul 25 01:58:41.754144 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:58:41.754049    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241\": container with ID starting with 497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241 not found: ID does not exist" containerID="497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"
Jul 25 01:58:41.754144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.754096    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241"} err="failed to get container status \"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241\": rpc error: code = NotFound desc = could not find container \"497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241\": container with ID starting with 497a844ab329844481edc202ce6fd1f7b06ae92fc4387921116fb1e88c4da241 not found: ID does not exist"
Jul 25 01:58:41.754144 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.754127    2565 scope.go:117] "RemoveContainer" containerID="1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"
Jul 25 01:58:41.754586 ip-10-0-130-23 kubenswrapper[2565]: E0725 01:58:41.754546    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d\": container with ID starting with 1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d not found: ID does not exist" containerID="1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"
Jul 25 01:58:41.754698 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.754595    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d"} err="failed to get container status \"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d\": rpc error: code = NotFound desc = could not find container \"1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d\": container with ID starting with 1b5a5191ecd2152bdf3b3c40bcfebdc17ad752f242490ae041bf3262c011be1d not found: ID does not exist"
Jul 25 01:58:41.756813 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:41.756791    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ed0d590f-openshift-default-5c7cb6c67b-7gqkq"]
Jul 25 01:58:43.645319 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:43.645284    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" path="/var/lib/kubelet/pods/294936c7-3ee1-4393-8d4f-220e5f2b8307/volumes"
Jul 25 01:58:44.065797 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:44.065695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:44.171453 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:44.171347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:44.276472 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:44.276435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:44.367048 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:44.367011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:58:44.752665 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:58:44.752537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:10.705424 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:10.705380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:16.707931 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:16.707824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:16.834646 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:16.834609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:16.961937 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:16.961844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:21.971105 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:21.971064    2565 scope.go:117] "RemoveContainer" containerID="016dd69b7ea9781aebf3d263f8aae9858d2d2f9f4ebf89617ef03a4baebffd4d"
Jul 25 01:59:32.773343 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:32.773305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:38.423124 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:38.423083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:38.525151 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:38.525112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:38.640683 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:38.640650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:49.166486 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:49.166448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:49.973038 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:49.972993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:56.370333 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:56.370285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:56.473677 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:56.473633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:56.577872 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:56.577822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:56.743023 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:56.742922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:57.431501 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:57.431469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:57.531695 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:57.531659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:57.634773 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:57.634743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 01:59:59.222792 ip-10-0-130-23 kubenswrapper[2565]: I0725 01:59:59.222754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:00.136800 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.136764    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"]
Jul 25 02:00:00.137198 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137184    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137210    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" containerName="payload-pre-processing"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137216    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" containerName="payload-pre-processing"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137234    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137243    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5359f27-303e-4137-b2ae-7a5b08132ec1" containerName="revoke-keys"
Jul 25 02:00:00.137247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137248    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5359f27-303e-4137-b2ae-7a5b08132ec1" containerName="revoke-keys"
Jul 25 02:00:00.137522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137313    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="546abbfc-c9eb-4b1c-bf66-66b671f14cc9" containerName="istio-proxy"
Jul 25 02:00:00.137522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137323    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5359f27-303e-4137-b2ae-7a5b08132ec1" containerName="revoke-keys"
Jul 25 02:00:00.137522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137331    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb83831-a4a0-4fd1-bb35-2e9402a0c4ac" containerName="payload-pre-processing"
Jul 25 02:00:00.137522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.137337    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:00.140742 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.140720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"
Jul 25 02:00:00.142771 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.142740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 02:00:00.158631 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.158596    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"]
Jul 25 02:00:00.163112 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.163081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"
Jul 25 02:00:00.311143 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:00.311103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"]
Jul 25 02:00:00.315062 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:00:00.315019    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0709ebfa_74d9_4d4b_8f7c_66d9ee8879c3.slice/crio-6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84 WatchSource:0}: Error finding container 6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84: Status 404 returned error can't find the container with id 6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84
Jul 25 02:00:01.170084 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:01.170039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf" event={"ID":"0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3","Type":"ContainerStarted","Data":"29e6c35034d5efec2f7e3b76e2373045f2fc7df2a835667769eddba1cdefa3f8"}
Jul 25 02:00:01.170311 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:01.170101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf" event={"ID":"0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3","Type":"ContainerStarted","Data":"6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84"}
Jul 25 02:00:01.183364 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:01.183309    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf" podStartSLOduration=1.183290852 podStartE2EDuration="1.183290852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:00:01.181567269 +0000 UTC m=+2920.084212281" watchObservedRunningTime="2026-07-25 02:00:01.183290852 +0000 UTC m=+2920.085935899"
Jul 25 02:00:02.176920 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:02.176880    2565 generic.go:356] "Generic (PLEG): container finished" podID="0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3" containerID="29e6c35034d5efec2f7e3b76e2373045f2fc7df2a835667769eddba1cdefa3f8" exitCode=0
Jul 25 02:00:02.177378 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:02.176968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf" event={"ID":"0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3","Type":"ContainerDied","Data":"29e6c35034d5efec2f7e3b76e2373045f2fc7df2a835667769eddba1cdefa3f8"}
Jul 25 02:00:03.327011 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:03.326981    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"
Jul 25 02:00:04.192019 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:04.191989    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf"
Jul 25 02:00:04.192019 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:04.192015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29749080-tm2kf" event={"ID":"0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3","Type":"ContainerDied","Data":"6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84"}
Jul 25 02:00:04.192249 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:04.192128    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ba1bd4278eae4a604ffdc64bfa83268ff9c1994a8a10fe91ebc6dc595ef5a84"
Jul 25 02:00:05.448347 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:05.448299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:05.551265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:05.551221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:06.170237 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:06.170197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:12.233360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.233322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:12.290719 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.290679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:12.482936 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.482889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:12.769403 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.769365    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:12.769812 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.769799    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3" containerName="cleanup"
Jul 25 02:00:12.769866 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.769814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3" containerName="cleanup"
Jul 25 02:00:12.769903 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.769890    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3" containerName="cleanup"
Jul 25 02:00:12.769903 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.769901    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="294936c7-3ee1-4393-8d4f-220e5f2b8307" containerName="istio-proxy"
Jul 25 02:00:12.773011 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.772989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.774730 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.774709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-17288039-openshift-default-dockercfg-pmq7j\""
Jul 25 02:00:12.781566 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.781499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:12.783652 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.783626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:12.791030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791208 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791208 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791208 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791208 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791401 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791401 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6xq\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791401 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.791401 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.791355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892638 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6xq\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.892853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.892854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.893251 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.893088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.893373 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.893339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.893534 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.893421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.893534 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.893453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.893669 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.893572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.895100 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.895079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.895375 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.895357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.900038 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.900011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.900150 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.900088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6xq\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq\") pod \"e2e-mt-17288039-openshift-default-887b868b4-5dbkk\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") " pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:12.954450 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:12.954406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:13.085808 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:13.085774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:13.245418 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:13.245388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:13.247315 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:00:13.247279    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda021cf64_c7bf_45ab_a8c1_f777536cf29e.slice/crio-f7bdd8e7eed213cbd5b370a5b210633cd1b4e792adca670c78d8eb668f2906b6 WatchSource:0}: Error finding container f7bdd8e7eed213cbd5b370a5b210633cd1b4e792adca670c78d8eb668f2906b6: Status 404 returned error can't find the container with id f7bdd8e7eed213cbd5b370a5b210633cd1b4e792adca670c78d8eb668f2906b6
Jul 25 02:00:13.249925 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:13.249879    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:13.250030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:13.249984    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:13.250081 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:13.250031    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:14.251564 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:14.251524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerStarted","Data":"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"}
Jul 25 02:00:14.252010 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:14.251578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerStarted","Data":"f7bdd8e7eed213cbd5b370a5b210633cd1b4e792adca670c78d8eb668f2906b6"}
Jul 25 02:00:14.269405 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:14.269314    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podStartSLOduration=2.269295419 podStartE2EDuration="2.269295419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:00:14.26783828 +0000 UTC m=+2933.170483292" watchObservedRunningTime="2026-07-25 02:00:14.269295419 +0000 UTC m=+2933.171940432"
Jul 25 02:00:15.086480 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:15.086435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:15.091645 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:15.091615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:15.256991 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:15.256956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:15.257961 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:15.257943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:16.275854 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:16.275823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:16.355827 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:16.355788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:16.416911 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:16.416866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:16.518764 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:16.518727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:16.933086 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:16.933047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:17.033909 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.033869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:17.066842 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.066801    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:17.070544 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.070497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.072871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.072841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-17288039-dockercfg-hmj92\""
Jul 25 02:00:17.073020 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.072905    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-17288039\""
Jul 25 02:00:17.078803 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.078776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:17.134452 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.134415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbr8\" (UniqueName: \"kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.134684 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.134473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.235681 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.235568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbr8\" (UniqueName: \"kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.235681 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.235627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.236408 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.236388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.244393 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.244363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbr8\" (UniqueName: \"kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8\") pod \"payload-processing-e2e-mt-17288039-5757df76bb-8rbbg\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") " pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.385323 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.385279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:17.536866 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:17.536807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:17.539588 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:00:17.539550    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92b5a78_2ba1_41ae_aedd_054765232ec0.slice/crio-263cee9bac71c474c39bcfee596b17655cde4c8e1c946badb909450c4e05e268 WatchSource:0}: Error finding container 263cee9bac71c474c39bcfee596b17655cde4c8e1c946badb909450c4e05e268: Status 404 returned error can't find the container with id 263cee9bac71c474c39bcfee596b17655cde4c8e1c946badb909450c4e05e268
Jul 25 02:00:18.275818 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:18.275776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" event={"ID":"f92b5a78-2ba1-41ae-aedd-054765232ec0","Type":"ContainerStarted","Data":"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"}
Jul 25 02:00:18.276022 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:18.275830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" event={"ID":"f92b5a78-2ba1-41ae-aedd-054765232ec0","Type":"ContainerStarted","Data":"263cee9bac71c474c39bcfee596b17655cde4c8e1c946badb909450c4e05e268"}
Jul 25 02:00:18.276022 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:18.275920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:18.292251 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:18.292193    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" podStartSLOduration=1.292173836 podStartE2EDuration="1.292173836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:00:18.289473815 +0000 UTC m=+2937.192118817" watchObservedRunningTime="2026-07-25 02:00:18.292173836 +0000 UTC m=+2937.194818848"
Jul 25 02:00:20.670010 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:20.669979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:21.316675 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:21.316606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:21.414882 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:21.414842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:21.515268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:21.515227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:21.757235 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:21.757196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:27.320592 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.320473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:27.353856 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.353818    2565 generic.go:356] "Generic (PLEG): container finished" podID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerID="fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c" exitCode=0
Jul 25 02:00:27.354040 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.353891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerDied","Data":"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"}
Jul 25 02:00:27.354358 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.354335    2565 scope.go:117] "RemoveContainer" containerID="fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"
Jul 25 02:00:27.355633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.355602    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:27.355705 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.355672    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:27.355745 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.355703    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:00:27.421795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.421762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:27.682877 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.682779    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"]
Jul 25 02:00:27.687378 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.687350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:27.689335 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.689307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 02:00:27.689875 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.689848    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 02:00:27.691851 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.691824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"]
Jul 25 02:00:27.753360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.753311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17288039-nv7bd\" (UID: \"c456e5fb-e02c-49b2-bd07-65f24c68030b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:27.854945 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.854899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17288039-nv7bd\" (UID: \"c456e5fb-e02c-49b2-bd07-65f24c68030b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:27.855906 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:27.855851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-17288039-nv7bd\" (UID: \"c456e5fb-e02c-49b2-bd07-65f24c68030b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:28.005001 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:28.004867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:28.197671 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:28.197633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"]
Jul 25 02:00:28.211238 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:00:28.211201    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc456e5fb_e02c_49b2_bd07_65f24c68030b.slice/crio-3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344 WatchSource:0}: Error finding container 3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344: Status 404 returned error can't find the container with id 3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344
Jul 25 02:00:28.361452 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:28.361413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd" event={"ID":"c456e5fb-e02c-49b2-bd07-65f24c68030b","Type":"ContainerStarted","Data":"3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344"}
Jul 25 02:00:28.363453 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:28.363429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerStarted","Data":"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"}
Jul 25 02:00:29.086389 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.086235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:29.087464 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.087435    2565 patch_prober.go:28] interesting pod/e2e-mt-17288039-openshift-default-887b868b4-5dbkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 25 02:00:29.087703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.087675    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 25 02:00:29.284776 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.284729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:29.370434 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.370341    2565 generic.go:356] "Generic (PLEG): container finished" podID="c456e5fb-e02c-49b2-bd07-65f24c68030b" containerID="4c23ad01b1389abe43fe287c98525596a79788362fb2c24dccb3f00295581dbf" exitCode=0
Jul 25 02:00:29.370850 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:29.370426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd" event={"ID":"c456e5fb-e02c-49b2-bd07-65f24c68030b","Type":"ContainerDied","Data":"4c23ad01b1389abe43fe287c98525596a79788362fb2c24dccb3f00295581dbf"}
Jul 25 02:00:30.086424 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.086376    2565 patch_prober.go:28] interesting pod/e2e-mt-17288039-openshift-default-887b868b4-5dbkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 25 02:00:30.086673 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.086445    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 25 02:00:30.257068 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.257025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:30.558651 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.558622    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:30.703367 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.703251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca\") pod \"c456e5fb-e02c-49b2-bd07-65f24c68030b\" (UID: \"c456e5fb-e02c-49b2-bd07-65f24c68030b\") "
Jul 25 02:00:30.703647 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.703623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c456e5fb-e02c-49b2-bd07-65f24c68030b" (UID: "c456e5fb-e02c-49b2-bd07-65f24c68030b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:00:30.805064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:30.805025    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c456e5fb-e02c-49b2-bd07-65f24c68030b-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:31.087127 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:31.087060    2565 patch_prober.go:28] interesting pod/e2e-mt-17288039-openshift-default-887b868b4-5dbkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 25 02:00:31.087356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:31.087166    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 25 02:00:31.387543 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:31.387407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd" event={"ID":"c456e5fb-e02c-49b2-bd07-65f24c68030b","Type":"ContainerDied","Data":"3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344"}
Jul 25 02:00:31.387543 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:31.387540    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a95011aebd015e63f632450598ed23ede30932caf57347a9fd69e5c979e9344"
Jul 25 02:00:31.387813 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:31.387617    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"
Jul 25 02:00:32.086587 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:32.086537    2565 patch_prober.go:28] interesting pod/e2e-mt-17288039-openshift-default-887b868b4-5dbkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 25 02:00:32.087128 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:32.086620    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 25 02:00:33.090170 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:33.090137    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:33.091183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:33.091164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:38.042770 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.042731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:38.072048 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.072004    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:38.072339 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.072288    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" podUID="f92b5a78-2ba1-41ae-aedd-054765232ec0" containerName="payload-processing" containerID="cri-o://bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576" gracePeriod=30
Jul 25 02:00:38.101905 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.101868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:38.159083 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.159043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:38.338761 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.338730    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:38.383407 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.383371    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tbr8\" (UniqueName: \"kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8\") pod \"f92b5a78-2ba1-41ae-aedd-054765232ec0\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") "
Jul 25 02:00:38.383654 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.383439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume\") pod \"f92b5a78-2ba1-41ae-aedd-054765232ec0\" (UID: \"f92b5a78-2ba1-41ae-aedd-054765232ec0\") "
Jul 25 02:00:38.383931 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.383898    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f92b5a78-2ba1-41ae-aedd-054765232ec0" (UID: "f92b5a78-2ba1-41ae-aedd-054765232ec0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:00:38.385906 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.385877    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8" (OuterVolumeSpecName: "kube-api-access-9tbr8") pod "f92b5a78-2ba1-41ae-aedd-054765232ec0" (UID: "f92b5a78-2ba1-41ae-aedd-054765232ec0"). InnerVolumeSpecName "kube-api-access-9tbr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:00:38.424801 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.424766    2565 generic.go:356] "Generic (PLEG): container finished" podID="f92b5a78-2ba1-41ae-aedd-054765232ec0" containerID="bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576" exitCode=0
Jul 25 02:00:38.425024 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.424812    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"
Jul 25 02:00:38.425024 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.424850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" event={"ID":"f92b5a78-2ba1-41ae-aedd-054765232ec0","Type":"ContainerDied","Data":"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"}
Jul 25 02:00:38.425024 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.424905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg" event={"ID":"f92b5a78-2ba1-41ae-aedd-054765232ec0","Type":"ContainerDied","Data":"263cee9bac71c474c39bcfee596b17655cde4c8e1c946badb909450c4e05e268"}
Jul 25 02:00:38.425024 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.424929    2565 scope.go:117] "RemoveContainer" containerID="bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"
Jul 25 02:00:38.434521 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.434487    2565 scope.go:117] "RemoveContainer" containerID="bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"
Jul 25 02:00:38.434868 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:00:38.434847    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576\": container with ID starting with bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576 not found: ID does not exist" containerID="bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"
Jul 25 02:00:38.434960 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.434875    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576"} err="failed to get container status \"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576\": rpc error: code = NotFound desc = could not find container \"bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576\": container with ID starting with bae9fc3bc8436779e427a5c153ee85395075905cdf7c8ad312736bb95e1b7576 not found: ID does not exist"
Jul 25 02:00:38.444308 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.444282    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:38.449221 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.449196    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-17288039-5757df76bb-8rbbg"]
Jul 25 02:00:38.484339 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.484303    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tbr8\" (UniqueName: \"kubernetes.io/projected/f92b5a78-2ba1-41ae-aedd-054765232ec0-kube-api-access-9tbr8\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:38.484339 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:38.484334    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b5a78-2ba1-41ae-aedd-054765232ec0-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:39.645689 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:39.645646    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92b5a78-2ba1-41ae-aedd-054765232ec0" path="/var/lib/kubelet/pods/f92b5a78-2ba1-41ae-aedd-054765232ec0/volumes"
Jul 25 02:00:42.752136 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:42.752040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:42.753759 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:42.753728    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"]
Jul 25 02:00:42.755823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:42.755799    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-17288039-nv7bd"]
Jul 25 02:00:43.114615 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:43.114578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:43.646280 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:43.646241    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c456e5fb-e02c-49b2-bd07-65f24c68030b" path="/var/lib/kubelet/pods/c456e5fb-e02c-49b2-bd07-65f24c68030b/volumes"
Jul 25 02:00:48.892408 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:48.892364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:48.950752 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:48.950718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:49.137969 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.137935    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:49.138273 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.138233    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy" containerID="cri-o://ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3" gracePeriod=30
Jul 25 02:00:49.158202 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.158090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:49.385727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.385689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:49.506759 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.506659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:49.607380 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.607342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:49.726315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:49.726282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:54.381716 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.381691    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:54.449241 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449241 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449444 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449444 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449444 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449444 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449441    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449483    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:00:54.449703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449557    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v6xq\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq\") pod \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\" (UID: \"a021cf64-c7bf-45ab-a8c1-f777536cf29e\") "
Jul 25 02:00:54.449910 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449807    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:00:54.449977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.449936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:00:54.450177 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.450148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:00:54.450315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.450174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:00:54.450315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.450172    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.450315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.450270    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.450315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.450293    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.451773 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.451747    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:00:54.451920 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.451900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq" (OuterVolumeSpecName: "kube-api-access-6v6xq") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "kube-api-access-6v6xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:00:54.452072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.452049    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:00:54.452072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.452064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a021cf64-c7bf-45ab-a8c1-f777536cf29e" (UID: "a021cf64-c7bf-45ab-a8c1-f777536cf29e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:00:54.532792 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.532756    2565 generic.go:356] "Generic (PLEG): container finished" podID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerID="ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3" exitCode=0
Jul 25 02:00:54.533029 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.532820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerDied","Data":"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"}
Jul 25 02:00:54.533029 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.532869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk" event={"ID":"a021cf64-c7bf-45ab-a8c1-f777536cf29e","Type":"ContainerDied","Data":"f7bdd8e7eed213cbd5b370a5b210633cd1b4e792adca670c78d8eb668f2906b6"}
Jul 25 02:00:54.533029 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.532825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"
Jul 25 02:00:54.533029 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.532918    2565 scope.go:117] "RemoveContainer" containerID="ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"
Jul 25 02:00:54.548998 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.548967    2565 scope.go:117] "RemoveContainer" containerID="fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"
Jul 25 02:00:54.551611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551578    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v6xq\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-kube-api-access-6v6xq\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.551611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551610    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.551795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551620    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.551795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551629    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.551795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551637    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.551795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.551644    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a021cf64-c7bf-45ab-a8c1-f777536cf29e-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:00:54.557641 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.557615    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:54.558427 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.558388    2565 scope.go:117] "RemoveContainer" containerID="ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"
Jul 25 02:00:54.559072 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:00:54.559022    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3\": container with ID starting with ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3 not found: ID does not exist" containerID="ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"
Jul 25 02:00:54.559204 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.559069    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3"} err="failed to get container status \"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3\": rpc error: code = NotFound desc = could not find container \"ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3\": container with ID starting with ee6f203ed06fb59802d6832d1f3337f4fd79304a0b8e469f3e2855c0224ad8d3 not found: ID does not exist"
Jul 25 02:00:54.559204 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.559092    2565 scope.go:117] "RemoveContainer" containerID="fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"
Jul 25 02:00:54.559446 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:00:54.559425    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c\": container with ID starting with fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c not found: ID does not exist" containerID="fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"
Jul 25 02:00:54.559522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.559452    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c"} err="failed to get container status \"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c\": rpc error: code = NotFound desc = could not find container \"fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c\": container with ID starting with fa9094c7beb6bd90d579a0adcc154b56e4e406512d0d385fb70ba2499098892c not found: ID does not exist"
Jul 25 02:00:54.561252 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:54.561229    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-17288039-openshift-default-887b868b4-5dbkk"]
Jul 25 02:00:55.583053 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:55.583015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:55.644043 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:55.643995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:55.646795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:55.646758    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" path="/var/lib/kubelet/pods/a021cf64-c7bf-45ab-a8c1-f777536cf29e/volumes"
Jul 25 02:00:55.726587 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:55.726551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:00:55.912475 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:00:55.912365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:00.877149 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:00.877108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:01.427769 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:01.427719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:01.479491 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:01.479459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:08.099216 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.099170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:08.379957 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.379870    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:01:08.380312 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380300    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c456e5fb-e02c-49b2-bd07-65f24c68030b" containerName="revoke-keys"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380314    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c456e5fb-e02c-49b2-bd07-65f24c68030b" containerName="revoke-keys"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380324    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380337    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92b5a78-2ba1-41ae-aedd-054765232ec0" containerName="payload-processing"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92b5a78-2ba1-41ae-aedd-054765232ec0" containerName="payload-processing"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380350    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380355 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380356    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380453    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92b5a78-2ba1-41ae-aedd-054765232ec0" containerName="payload-processing"
Jul 25 02:01:08.380612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380464    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380474    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a021cf64-c7bf-45ab-a8c1-f777536cf29e" containerName="istio-proxy"
Jul 25 02:01:08.380612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.380482    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c456e5fb-e02c-49b2-bd07-65f24c68030b" containerName="revoke-keys"
Jul 25 02:01:08.384003 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.383978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.385897 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.385867    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dc5514f6-openshift-default-dockercfg-h6nn4\""
Jul 25 02:01:08.396770 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.396743    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:01:08.407226 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.407196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:08.498988 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.498947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.498996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7sn\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.499374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.499298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600614 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600614 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7sn\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.600870 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.600857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.601225 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.601198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.601278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.601250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.601340 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.601320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.601396 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.601345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.601650 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.601621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.603262 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.603236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.603376 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.603354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.607628 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.607606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.608028 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.608005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7sn\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn\") pod \"e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") " pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.696569 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.696435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:08.845103 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.845060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:01:08.853267 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.853237    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:08.853356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.853304    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:08.853356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.853338    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:08.878921 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:08.878885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:09.622842 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:09.622804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerStarted","Data":"7394828a4b6c4877a878adcec106f9884453a9ff82d4ef3d2ef28a6249e3eed6"}
Jul 25 02:01:09.623238 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:09.622873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerStarted","Data":"84f795e1bbcfacf4ecddf544a9de6b546298eed37b798190dca062e9ef8ef283"}
Jul 25 02:01:09.643304 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:09.643257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podStartSLOduration=1.643238062 podStartE2EDuration="1.643238062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:01:09.639618831 +0000 UTC m=+2988.542263845" watchObservedRunningTime="2026-07-25 02:01:09.643238062 +0000 UTC m=+2988.545883073"
Jul 25 02:01:09.697077 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:09.697033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:09.702423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:09.702396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:10.628578 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:10.628544    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:10.629679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:10.629654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:11.539771 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:11.539728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:11.643125 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:11.643090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:11.786821 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:11.786787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:12.038810 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.038773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:12.248866 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.248830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:12.349682 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.349641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:12.356530 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.356486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:01:12.360466 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.360440    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.362247 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.362224    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dc5514f6-dockercfg-nrb52\""
Jul 25 02:01:12.362365 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.362225    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dc5514f6\""
Jul 25 02:01:12.370757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.370717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:01:12.384172 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.384137    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:01:12.388045 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.388016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.397498 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.397470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:01:12.441589 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.441495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.441589 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.441591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpkz7\" (UniqueName: \"kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.441852 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.441617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbdqk\" (UniqueName: \"kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.441852 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.441665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.542470 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.542424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.542727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.542591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.542727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.542624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpkz7\" (UniqueName: \"kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.542727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.542655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbdqk\" (UniqueName: \"kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.543273 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.543251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.543360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.543341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.555403 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.555373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbdqk\" (UniqueName: \"kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk\") pod \"payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.555561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.555537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpkz7\" (UniqueName: \"kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7\") pod \"payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") " pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.672606 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.672481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:12.700396 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.700358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:12.868328 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:12.868200    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:01:12.871395 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:01:12.871368    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c7cb41_d1e8_40bf_a217_3631ef03447a.slice/crio-027af55ed20592a453290847b3d0aa97338bb4a85bb9e4231c8c2250eb3256f5 WatchSource:0}: Error finding container 027af55ed20592a453290847b3d0aa97338bb4a85bb9e4231c8c2250eb3256f5: Status 404 returned error can't find the container with id 027af55ed20592a453290847b3d0aa97338bb4a85bb9e4231c8c2250eb3256f5
Jul 25 02:01:13.040567 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.040462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:01:13.043442 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:01:13.043414    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a95cca2_ee0c_4c53_a9fb_df661b90c18b.slice/crio-412b816b2f5866b3c5d90a735a03e5eac6f5d2ba32ec218c6d05c6ff740691fa WatchSource:0}: Error finding container 412b816b2f5866b3c5d90a735a03e5eac6f5d2ba32ec218c6d05c6ff740691fa: Status 404 returned error can't find the container with id 412b816b2f5866b3c5d90a735a03e5eac6f5d2ba32ec218c6d05c6ff740691fa
Jul 25 02:01:13.647748 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.647705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" event={"ID":"4a95cca2-ee0c-4c53-a9fb-df661b90c18b","Type":"ContainerStarted","Data":"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"}
Jul 25 02:01:13.647978 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.647784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" event={"ID":"4a95cca2-ee0c-4c53-a9fb-df661b90c18b","Type":"ContainerStarted","Data":"412b816b2f5866b3c5d90a735a03e5eac6f5d2ba32ec218c6d05c6ff740691fa"}
Jul 25 02:01:13.647978 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.647874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:13.649548 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.649500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" event={"ID":"f8c7cb41-d1e8-40bf-a217-3631ef03447a","Type":"ContainerStarted","Data":"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"}
Jul 25 02:01:13.649692 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.649562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" event={"ID":"f8c7cb41-d1e8-40bf-a217-3631ef03447a","Type":"ContainerStarted","Data":"027af55ed20592a453290847b3d0aa97338bb4a85bb9e4231c8c2250eb3256f5"}
Jul 25 02:01:13.649692 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.649587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:13.664061 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.664005    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" podStartSLOduration=1.663984944 podStartE2EDuration="1.663984944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:01:13.661825351 +0000 UTC m=+2992.564470365" watchObservedRunningTime="2026-07-25 02:01:13.663984944 +0000 UTC m=+2992.566630003"
Jul 25 02:01:13.675883 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:13.675819    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" podStartSLOduration=1.675798322 podStartE2EDuration="1.675798322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:01:13.675069542 +0000 UTC m=+2992.577714568" watchObservedRunningTime="2026-07-25 02:01:13.675798322 +0000 UTC m=+2992.578443337"
Jul 25 02:01:16.022217 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:16.022179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:24.455867 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:24.455820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:01:24.657618 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:24.657588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:01:24.657800 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:24.657659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:01:25.986953 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:25.986182    2565 patch_prober.go:28] interesting pod/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": read tcp 10.134.0.2:32828->10.134.0.54:15021: read: connection reset by peer" start-of-body=
Jul 25 02:01:25.986953 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:25.986251    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": read tcp 10.134.0.2:32828->10.134.0.54:15021: read: connection reset by peer"
Jul 25 02:01:26.742462 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.742428    2565 generic.go:356] "Generic (PLEG): container finished" podID="911a8528-6372-496c-9390-e7fa315a17a4" containerID="7394828a4b6c4877a878adcec106f9884453a9ff82d4ef3d2ef28a6249e3eed6" exitCode=0
Jul 25 02:01:26.742669 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.742499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerDied","Data":"7394828a4b6c4877a878adcec106f9884453a9ff82d4ef3d2ef28a6249e3eed6"}
Jul 25 02:01:26.743013 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.742980    2565 scope.go:117] "RemoveContainer" containerID="7394828a4b6c4877a878adcec106f9884453a9ff82d4ef3d2ef28a6249e3eed6"
Jul 25 02:01:26.744128 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.744100    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:26.744190 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.744169    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:26.744227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:26.744199    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:01:27.750204 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:27.750171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerStarted","Data":"4cf50318d5bed81450256648ba8eccf740c976af5f4ae4cc3e785550c65225a4"}
Jul 25 02:01:28.697392 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:28.697346    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:28.697654 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:28.697491    2565 patch_prober.go:28] interesting pod/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 25 02:01:28.697654 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:28.697558    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 25 02:01:29.697712 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:29.697667    2565 patch_prober.go:28] interesting pod/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 25 02:01:29.698269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:29.697746    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 25 02:01:30.697577 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:30.697533    2565 patch_prober.go:28] interesting pod/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 25 02:01:30.697830 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:30.697609    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 25 02:01:31.697422 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:31.697371    2565 patch_prober.go:28] interesting pod/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 25 02:01:31.697666 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:31.697428    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 25 02:01:32.700673 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:32.700640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:32.701130 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:32.701046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:32.701908 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:32.701891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:01:45.502359 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.502317    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"]
Jul 25 02:01:45.506174 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.506148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:45.508056 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.508030    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 02:01:45.508210 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.508077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 02:01:45.514402 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.514371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"]
Jul 25 02:01:45.586757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.586714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr\" (UID: \"69be0bea-768d-4dcf-8f46-e71daade71af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:45.688295 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.688085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr\" (UID: \"69be0bea-768d-4dcf-8f46-e71daade71af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:45.688883 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.688812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr\" (UID: \"69be0bea-768d-4dcf-8f46-e71daade71af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:45.820318 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.820204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:45.968132 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:45.968103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"]
Jul 25 02:01:45.970714 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:01:45.970673    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69be0bea_768d_4dcf_8f46_e71daade71af.slice/crio-505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041 WatchSource:0}: Error finding container 505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041: Status 404 returned error can't find the container with id 505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041
Jul 25 02:01:46.861880 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:46.861846    2565 generic.go:356] "Generic (PLEG): container finished" podID="69be0bea-768d-4dcf-8f46-e71daade71af" containerID="ffdd77c0106f66fad77eff47a6f6af074bc63120c33eaaedaaab201a5ecda7ae" exitCode=0
Jul 25 02:01:46.862255 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:46.861941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr" event={"ID":"69be0bea-768d-4dcf-8f46-e71daade71af","Type":"ContainerDied","Data":"ffdd77c0106f66fad77eff47a6f6af074bc63120c33eaaedaaab201a5ecda7ae"}
Jul 25 02:01:46.862255 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:46.861993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr" event={"ID":"69be0bea-768d-4dcf-8f46-e71daade71af","Type":"ContainerStarted","Data":"505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041"}
Jul 25 02:01:48.021398 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.021364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:48.114494 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.114448    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca\") pod \"69be0bea-768d-4dcf-8f46-e71daade71af\" (UID: \"69be0bea-768d-4dcf-8f46-e71daade71af\") "
Jul 25 02:01:48.114833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.114811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69be0bea-768d-4dcf-8f46-e71daade71af" (UID: "69be0bea-768d-4dcf-8f46-e71daade71af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:01:48.216421 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.216314    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69be0bea-768d-4dcf-8f46-e71daade71af-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:01:48.874945 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.874917    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"
Jul 25 02:01:48.874945 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.874927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr" event={"ID":"69be0bea-768d-4dcf-8f46-e71daade71af","Type":"ContainerDied","Data":"505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041"}
Jul 25 02:01:48.875167 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:01:48.874968    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="505a1442b032bb522bfe602b72c3ef5b6511865c67d712b308ffb2adb6e6c041"
Jul 25 02:02:00.976453 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:00.976417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:01.000032 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:00.999995    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:02:01.000282 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.000255    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" podUID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" containerName="payload-processing" containerID="cri-o://53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391" gracePeriod=30
Jul 25 02:02:01.006076 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.006044    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:02:01.006309 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.006277    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" podUID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" containerName="payload-pre-processing" containerID="cri-o://614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f" gracePeriod=30
Jul 25 02:02:01.037665 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.037591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:01.101643 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.101610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:01.305031 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.304995    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:02:01.318016 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.317988    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:02:01.354360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpkz7\" (UniqueName: \"kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7\") pod \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") "
Jul 25 02:02:01.354571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbdqk\" (UniqueName: \"kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk\") pod \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") "
Jul 25 02:02:01.354571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume\") pod \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\" (UID: \"4a95cca2-ee0c-4c53-a9fb-df661b90c18b\") "
Jul 25 02:02:01.354571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354502    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume\") pod \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\" (UID: \"f8c7cb41-d1e8-40bf-a217-3631ef03447a\") "
Jul 25 02:02:01.354887 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354857    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a95cca2-ee0c-4c53-a9fb-df661b90c18b" (UID: "4a95cca2-ee0c-4c53-a9fb-df661b90c18b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:02:01.354967 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.354929    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8c7cb41-d1e8-40bf-a217-3631ef03447a" (UID: "f8c7cb41-d1e8-40bf-a217-3631ef03447a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:02:01.356740 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.356719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7" (OuterVolumeSpecName: "kube-api-access-lpkz7") pod "f8c7cb41-d1e8-40bf-a217-3631ef03447a" (UID: "f8c7cb41-d1e8-40bf-a217-3631ef03447a"). InnerVolumeSpecName "kube-api-access-lpkz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:02:01.356899 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.356881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk" (OuterVolumeSpecName: "kube-api-access-nbdqk") pod "4a95cca2-ee0c-4c53-a9fb-df661b90c18b" (UID: "4a95cca2-ee0c-4c53-a9fb-df661b90c18b"). InnerVolumeSpecName "kube-api-access-nbdqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:02:01.455710 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.455669    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c7cb41-d1e8-40bf-a217-3631ef03447a-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:02:01.455710 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.455703    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpkz7\" (UniqueName: \"kubernetes.io/projected/f8c7cb41-d1e8-40bf-a217-3631ef03447a-kube-api-access-lpkz7\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:02:01.455710 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.455714    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbdqk\" (UniqueName: \"kubernetes.io/projected/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-kube-api-access-nbdqk\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:02:01.455710 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.455723    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a95cca2-ee0c-4c53-a9fb-df661b90c18b-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:02:01.947265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.947166    2565 generic.go:356] "Generic (PLEG): container finished" podID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" containerID="53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391" exitCode=0
Jul 25 02:02:01.947265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.947214    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"
Jul 25 02:02:01.947265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.947250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" event={"ID":"f8c7cb41-d1e8-40bf-a217-3631ef03447a","Type":"ContainerDied","Data":"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"}
Jul 25 02:02:01.947626 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.947302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2" event={"ID":"f8c7cb41-d1e8-40bf-a217-3631ef03447a","Type":"ContainerDied","Data":"027af55ed20592a453290847b3d0aa97338bb4a85bb9e4231c8c2250eb3256f5"}
Jul 25 02:02:01.947626 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.947326    2565 scope.go:117] "RemoveContainer" containerID="53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"
Jul 25 02:02:01.948785 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.948762    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" containerID="614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f" exitCode=0
Jul 25 02:02:01.948923 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.948801    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"
Jul 25 02:02:01.948923 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.948852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" event={"ID":"4a95cca2-ee0c-4c53-a9fb-df661b90c18b","Type":"ContainerDied","Data":"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"}
Jul 25 02:02:01.948923 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.948891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl" event={"ID":"4a95cca2-ee0c-4c53-a9fb-df661b90c18b","Type":"ContainerDied","Data":"412b816b2f5866b3c5d90a735a03e5eac6f5d2ba32ec218c6d05c6ff740691fa"}
Jul 25 02:02:01.957196 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.957172    2565 scope.go:117] "RemoveContainer" containerID="53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"
Jul 25 02:02:01.957552 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:02:01.957530    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391\": container with ID starting with 53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391 not found: ID does not exist" containerID="53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"
Jul 25 02:02:01.957633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.957564    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391"} err="failed to get container status \"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391\": rpc error: code = NotFound desc = could not find container \"53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391\": container with ID starting with 53681b52e89c1b5d48ae8c3b0c060b87cf2fc323162afe4b94e08840dfe26391 not found: ID does not exist"
Jul 25 02:02:01.957633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.957581    2565 scope.go:117] "RemoveContainer" containerID="614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"
Jul 25 02:02:01.965964 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.965935    2565 scope.go:117] "RemoveContainer" containerID="614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"
Jul 25 02:02:01.966273 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:02:01.966256    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f\": container with ID starting with 614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f not found: ID does not exist" containerID="614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"
Jul 25 02:02:01.966362 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.966281    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f"} err="failed to get container status \"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f\": rpc error: code = NotFound desc = could not find container \"614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f\": container with ID starting with 614d85ae958aa68bbf82bc459589df8c39da4226eb642c6443fe507b7d75f73f not found: ID does not exist"
Jul 25 02:02:01.976889 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.976864    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:02:01.979799 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.979772    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dc5514f6-677894bdfd-j85d2"]
Jul 25 02:02:01.994302 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.994255    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:02:01.994498 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:01.994320    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dc5514f6-6c78c489cb-jkwsl"]
Jul 25 02:02:02.451787 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:02.451735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:03.645443 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:03.645410    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" path="/var/lib/kubelet/pods/4a95cca2-ee0c-4c53-a9fb-df661b90c18b/volumes"
Jul 25 02:02:03.645859 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:03.645823    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" path="/var/lib/kubelet/pods/f8c7cb41-d1e8-40bf-a217-3631ef03447a/volumes"
Jul 25 02:02:05.578394 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:05.578350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:05.579400 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:05.579369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"]
Jul 25 02:02:05.581991 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:05.581950    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dc5514f6-4gzbr"]
Jul 25 02:02:05.645731 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:05.645696    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69be0bea-768d-4dcf-8f46-e71daade71af" path="/var/lib/kubelet/pods/69be0bea-768d-4dcf-8f46-e71daade71af/volumes"
Jul 25 02:02:09.026210 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:09.026171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:14.053395 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:14.053302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:50.173965 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:50.173930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:51.219655 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:51.219608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:56.796716 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:56.796684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:56.901374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:56.901343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:57.069987 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:57.069909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:02:57.070204 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:57.070173    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy" containerID="cri-o://4cf50318d5bed81450256648ba8eccf740c976af5f4ae4cc3e785550c65225a4" gracePeriod=30
Jul 25 02:02:57.077085 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:57.077053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:57.314728 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:57.314686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:58.410885 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:58.410836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:58.511124 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:58.511093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:58.613081 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:58.613046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:59.341187 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:59.341151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:59.443920 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:59.443889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:02:59.542454 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:02:59.542422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:00.969441 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:00.969409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:02.271997 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.271971    2565 generic.go:356] "Generic (PLEG): container finished" podID="911a8528-6372-496c-9390-e7fa315a17a4" containerID="4cf50318d5bed81450256648ba8eccf740c976af5f4ae4cc3e785550c65225a4" exitCode=0
Jul 25 02:03:02.272418 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.272010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerDied","Data":"4cf50318d5bed81450256648ba8eccf740c976af5f4ae4cc3e785550c65225a4"}
Jul 25 02:03:02.272418 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.272064    2565 scope.go:117] "RemoveContainer" containerID="7394828a4b6c4877a878adcec106f9884453a9ff82d4ef3d2ef28a6249e3eed6"
Jul 25 02:03:02.317821 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.317801    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:03:02.370347 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370347 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370545 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370391    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370545 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370545 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370436    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z7sn\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370545 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370455    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370545 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370811 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370811 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370599    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket\") pod \"911a8528-6372-496c-9390-e7fa315a17a4\" (UID: \"911a8528-6372-496c-9390-e7fa315a17a4\") "
Jul 25 02:03:02.370811 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:03:02.370963 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:03:02.370963 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.370905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:03:02.371078 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371057    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:03:02.371241 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371224    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.371314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371247    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.371314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371260    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/911a8528-6372-496c-9390-e7fa315a17a4-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.371314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371273    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.371314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.371280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:03:02.372718 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.372687    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn" (OuterVolumeSpecName: "kube-api-access-2z7sn") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "kube-api-access-2z7sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:03:02.372830 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.372816    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:03:02.372998 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.372980    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:03:02.373054 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.372997    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "911a8528-6372-496c-9390-e7fa315a17a4" (UID: "911a8528-6372-496c-9390-e7fa315a17a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:03:02.471757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.471725    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z7sn\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-kube-api-access-2z7sn\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.471757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.471752    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.471757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.471763    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911a8528-6372-496c-9390-e7fa315a17a4-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.471951 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.471771    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/911a8528-6372-496c-9390-e7fa315a17a4-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:02.471951 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:02.471778    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/911a8528-6372-496c-9390-e7fa315a17a4-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:03:03.278772 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.278742    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"
Jul 25 02:03:03.278772 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.278758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f" event={"ID":"911a8528-6372-496c-9390-e7fa315a17a4","Type":"ContainerDied","Data":"84f795e1bbcfacf4ecddf544a9de6b546298eed37b798190dca062e9ef8ef283"}
Jul 25 02:03:03.279332 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.278813    2565 scope.go:117] "RemoveContainer" containerID="4cf50318d5bed81450256648ba8eccf740c976af5f4ae4cc3e785550c65225a4"
Jul 25 02:03:03.300559 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.300528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:03:03.304572 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.304548    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dc5514f6-openshift-default-689b5dcddd-j5j8f"]
Jul 25 02:03:03.646311 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:03.646281    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="911a8528-6372-496c-9390-e7fa315a17a4" path="/var/lib/kubelet/pods/911a8528-6372-496c-9390-e7fa315a17a4/volumes"
Jul 25 02:03:06.780779 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:06.780746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:06.851437 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:06.851405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:07.472070 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:07.472031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:13.759775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:13.759738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:13.861981 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:13.861944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:13.959833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:13.959802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:24.513503 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:24.513463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:24.856964 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:24.856923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:45.845203 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:45.845123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:51.874162 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:51.874119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:51.974975 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:51.974943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:52.240351 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.240254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:52.541401 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.541311    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:03:52.541994 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.541967    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.541994 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.541990    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542000    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" containerName="payload-processing"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542008    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" containerName="payload-processing"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542023    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542031    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542054    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" containerName="payload-pre-processing"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542062    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" containerName="payload-pre-processing"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542085    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69be0bea-768d-4dcf-8f46-e71daade71af" containerName="revoke-keys"
Jul 25 02:03:52.542183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542094    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69be0bea-768d-4dcf-8f46-e71daade71af" containerName="revoke-keys"
Jul 25 02:03:52.542633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542195    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a95cca2-ee0c-4c53-a9fb-df661b90c18b" containerName="payload-pre-processing"
Jul 25 02:03:52.542633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542212    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.542633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542224    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c7cb41-d1e8-40bf-a217-3631ef03447a" containerName="payload-processing"
Jul 25 02:03:52.542633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542232    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="69be0bea-768d-4dcf-8f46-e71daade71af" containerName="revoke-keys"
Jul 25 02:03:52.542633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.542244    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="911a8528-6372-496c-9390-e7fa315a17a4" containerName="istio-proxy"
Jul 25 02:03:52.545909 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.545889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.547632 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.547612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c13f56-openshift-default-dockercfg-l9kvq\""
Jul 25 02:03:52.555703 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.555679    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:03:52.565676 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.565652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:52.636258 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.636224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvnw\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.636638 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.636579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.636918 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.636891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637124 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637254 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637965 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637965 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637965 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.637965 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.637955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.738946 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.738914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvnw\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739117 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.738957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739117 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.738999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739117 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739117 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739271 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739271 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739271 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739420 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739619 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739773 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739773 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.739895 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.739786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.740127 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.740101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.741268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.741242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.741544 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.741529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.746760 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.746736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvnw\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.746845 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.746797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token\") pod \"e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") " pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.859753 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.859728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:52.998811 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:52.998786    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:03:53.001121 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:03:53.001092    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7053e3c_5730_4e33_9443_10b4e80b4969.slice/crio-88ea5255d45730bc57e309ff4eeafdc7bf43b7f560f656258facf29667f1186c WatchSource:0}: Error finding container 88ea5255d45730bc57e309ff4eeafdc7bf43b7f560f656258facf29667f1186c: Status 404 returned error can't find the container with id 88ea5255d45730bc57e309ff4eeafdc7bf43b7f560f656258facf29667f1186c
Jul 25 02:03:53.003647 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.003601    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:03:53.003730 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.003699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:03:53.003774 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.003753    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:03:53.037726 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.037699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:53.534966 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.534930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerStarted","Data":"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"}
Jul 25 02:03:53.535144 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.535010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerStarted","Data":"88ea5255d45730bc57e309ff4eeafdc7bf43b7f560f656258facf29667f1186c"}
Jul 25 02:03:53.555336 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.555289    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podStartSLOduration=1.555274533 podStartE2EDuration="1.555274533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:03:53.552852963 +0000 UTC m=+3152.455497975" watchObservedRunningTime="2026-07-25 02:03:53.555274533 +0000 UTC m=+3152.457919546"
Jul 25 02:03:53.859853 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:53.859824    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:54.865044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:54.865017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:55.514061 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:55.514024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:55.545607 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:55.545579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:55.546580 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:55.546561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:03:55.621420 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:55.621376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:55.762557 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:55.762524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:56.168057 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.168013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:56.397349 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.397316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:56.496056 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.495981    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:03:56.497943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.497918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:03:56.499758 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.499740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.501318 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.501297    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c13f56\""
Jul 25 02:03:56.508886 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.508866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:03:56.511663 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.511642    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:03:56.524897 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.524874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.526960 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.526936    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c13f56-dockercfg-lt7bn\""
Jul 25 02:03:56.530245 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.530225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:03:56.575967 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.575942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmf69\" (UniqueName: \"kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.576116 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.575974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxft\" (UniqueName: \"kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.576116 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.575997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.576116 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.576088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.676833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.676794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmf69\" (UniqueName: \"kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.677051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.676838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxft\" (UniqueName: \"kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.677051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.676872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.677051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.676946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.677859 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.677836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.677859 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.677850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.684386 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.684367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmf69\" (UniqueName: \"kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69\") pod \"payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.684480 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.684372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxft\" (UniqueName: \"kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft\") pod \"payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:56.813327 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.813240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:56.836359 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:56.836334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:57.170270 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.170103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:03:57.172565 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:03:57.172541    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14aaf5e8_ba35_4f27_83f7_318aa69ca750.slice/crio-4bd25a599e65b80a6907c64b225df02bb1e4ad3ea939d7d6640b1a06a3d1b851 WatchSource:0}: Error finding container 4bd25a599e65b80a6907c64b225df02bb1e4ad3ea939d7d6640b1a06a3d1b851: Status 404 returned error can't find the container with id 4bd25a599e65b80a6907c64b225df02bb1e4ad3ea939d7d6640b1a06a3d1b851
Jul 25 02:03:57.196021 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.195997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:03:57.204555 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:03:57.204530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104aff25_b4ff_451e_9647_57cf03b8930d.slice/crio-e90211dcdc3d9260adeada5bc8d7d14f4fec16c5896d424b3f9de73fb7184eea WatchSource:0}: Error finding container e90211dcdc3d9260adeada5bc8d7d14f4fec16c5896d424b3f9de73fb7184eea: Status 404 returned error can't find the container with id e90211dcdc3d9260adeada5bc8d7d14f4fec16c5896d424b3f9de73fb7184eea
Jul 25 02:03:57.557571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.557463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" event={"ID":"104aff25-b4ff-451e-9647-57cf03b8930d","Type":"ContainerStarted","Data":"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"}
Jul 25 02:03:57.557571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.557543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" event={"ID":"104aff25-b4ff-451e-9647-57cf03b8930d","Type":"ContainerStarted","Data":"e90211dcdc3d9260adeada5bc8d7d14f4fec16c5896d424b3f9de73fb7184eea"}
Jul 25 02:03:57.557771 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.557634    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:03:57.558992 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.558970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" event={"ID":"14aaf5e8-ba35-4f27-83f7-318aa69ca750","Type":"ContainerStarted","Data":"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"}
Jul 25 02:03:57.559093 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.559003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" event={"ID":"14aaf5e8-ba35-4f27-83f7-318aa69ca750","Type":"ContainerStarted","Data":"4bd25a599e65b80a6907c64b225df02bb1e4ad3ea939d7d6640b1a06a3d1b851"}
Jul 25 02:03:57.559093 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.559022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:03:57.571319 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:03:57.571274    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" podStartSLOduration=1.571257693 podStartE2EDuration="1.571257693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:03:57.570740197 +0000 UTC m=+3156.473385225" watchObservedRunningTime="2026-07-25 02:03:57.571257693 +0000 UTC m=+3156.473902706"
Jul 25 02:04:00.046201 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.046147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:00.401536 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.401483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:00.695258 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.695167    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" podStartSLOduration=4.695151668 podStartE2EDuration="4.695151668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:03:57.59176679 +0000 UTC m=+3156.494411801" watchObservedRunningTime="2026-07-25 02:04:00.695151668 +0000 UTC m=+3159.597796678"
Jul 25 02:04:00.696110 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.696092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:04:00.699944 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.699919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.701771 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.701749    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1a3abd-openshift-default-dockercfg-m9ptr\""
Jul 25 02:04:00.711984 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.711962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:04:00.732023 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.731993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:00.823414 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823803 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmcx\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823803 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823803 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.823803 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.823723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.825764 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.825736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:00.924847 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.924998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmcx\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925388 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925388 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925388 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925621 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925621 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.925946 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.925927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.927383 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.927352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.927620 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.927601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.932663 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.932642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:00.932857 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:00.932840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmcx\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx\") pod \"e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") " pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:01.012647 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.012580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:01.146763 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.146741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:04:01.148929 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:04:01.148899    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde905158_4374_4877_85fc_e06f70b70051.slice/crio-899f247aa9e8a7548714b8416f9b1efbc0ae5d84c12c5f272abf86e68afd5d71 WatchSource:0}: Error finding container 899f247aa9e8a7548714b8416f9b1efbc0ae5d84c12c5f272abf86e68afd5d71: Status 404 returned error can't find the container with id 899f247aa9e8a7548714b8416f9b1efbc0ae5d84c12c5f272abf86e68afd5d71
Jul 25 02:04:01.151175 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.151147    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:01.151252 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.151209    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:01.151252 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.151234    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:01.581617 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.581579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerStarted","Data":"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"}
Jul 25 02:04:01.581794 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.581633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerStarted","Data":"899f247aa9e8a7548714b8416f9b1efbc0ae5d84c12c5f272abf86e68afd5d71"}
Jul 25 02:04:01.598423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:01.598371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podStartSLOduration=1.5983519309999998 podStartE2EDuration="1.598351931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:04:01.596777871 +0000 UTC m=+3160.499422882" watchObservedRunningTime="2026-07-25 02:04:01.598351931 +0000 UTC m=+3160.500996941"
Jul 25 02:04:02.013236 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:02.013151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:02.018473 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:02.018449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:02.602103 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:02.602063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:02.603312 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:02.603285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:03.516185 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:03.516155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:03.630241 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:03.630201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:03.758167 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:03.758139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:03.884454 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:03.884413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:04.298467 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:04.298354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:04.400242 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:04.400209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:07.969165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:07.969114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:08.567088 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:08.567059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:04:08.567261 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:08.567129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:04:09.648387 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.648355    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerID="9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8" exitCode=0
Jul 25 02:04:09.648936 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.648431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerDied","Data":"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"}
Jul 25 02:04:09.648936 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.648900    2565 scope.go:117] "RemoveContainer" containerID="9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"
Jul 25 02:04:09.649982 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.649955    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:09.650085 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.650020    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:09.650085 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:09.650053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:10.413568 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.413500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:04:10.546089 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.546063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:04:10.655480 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.655445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerStarted","Data":"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"}
Jul 25 02:04:10.860380 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.860345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:04:10.861799 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.861773    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 25 02:04:10.861920 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:10.861817    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 25 02:04:11.861126 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:11.861087    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 25 02:04:11.861642 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:11.861150    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 25 02:04:12.860088 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:12.860045    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 25 02:04:12.860305 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:12.860114    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 25 02:04:13.860845 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:13.860812    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 25 02:04:13.861256 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:13.860866    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 25 02:04:14.864361 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:14.864328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:04:14.864887 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:14.864623    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:04:14.865334 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:14.865315    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:04:15.684644 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.684547    2565 generic.go:356] "Generic (PLEG): container finished" podID="de905158-4374-4877-85fc-e06f70b70051" containerID="26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61" exitCode=0
Jul 25 02:04:15.684644 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.684621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerDied","Data":"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"}
Jul 25 02:04:15.685179 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.685165    2565 scope.go:117] "RemoveContainer" containerID="26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"
Jul 25 02:04:15.686244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.686122    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:15.686244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.686184    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:15.686244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:15.686211    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:04:16.699689 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:16.699650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerStarted","Data":"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"}
Jul 25 02:04:17.012945 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:17.012844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:17.013879 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:17.013857    2565 patch_prober.go:28] interesting pod/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 25 02:04:17.013981 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:17.013913    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 25 02:04:17.602411 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:17.602372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:18.013483 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:18.013392    2565 patch_prober.go:28] interesting pod/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 25 02:04:18.013483 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:18.013455    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 25 02:04:19.013467 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:19.013425    2565 patch_prober.go:28] interesting pod/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 25 02:04:19.013677 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:19.013488    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 25 02:04:20.013084 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:20.013051    2565 patch_prober.go:28] interesting pod/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 25 02:04:20.013263 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:20.013109    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 25 02:04:21.016905 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:21.016877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:21.017956 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:21.017937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:04:22.058187 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:22.058150    2565 scope.go:117] "RemoveContainer" containerID="bb4a28981f99bd40172cf3afd12c64a9bd6f27da3a18614569d61a6abef3c22b"
Jul 25 02:04:50.729097 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:04:50.729067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:33.077863 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:33.077830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:33.166386 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:33.166353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:33.221550 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:33.221498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:34.230397 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.230367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:34.351530 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.351490    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"]
Jul 25 02:05:34.355129 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.355109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:34.356786 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.356765    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 02:05:34.356869 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.356768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 02:05:34.362019 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.361985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"]
Jul 25 02:05:34.466333 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.466299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj\" (UID: \"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:34.567782 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.567697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj\" (UID: \"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:34.568377 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.568354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj\" (UID: \"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:34.667858 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:34.667826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:35.006075 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:35.006051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"]
Jul 25 02:05:35.008018 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:05:35.007994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8f676c_19a5_4ca9_adb3_cfbd54b591ed.slice/crio-39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42 WatchSource:0}: Error finding container 39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42: Status 404 returned error can't find the container with id 39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42
Jul 25 02:05:35.125549 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:35.125502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj" event={"ID":"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed","Type":"ContainerStarted","Data":"39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42"}
Jul 25 02:05:36.131817 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:36.131788    2565 generic.go:356] "Generic (PLEG): container finished" podID="2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" containerID="4f112a1f57fdad3943ba9e416b9c572402aeb8bd53ff172007f55938751378d6" exitCode=0
Jul 25 02:05:36.132223 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:36.131868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj" event={"ID":"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed","Type":"ContainerDied","Data":"4f112a1f57fdad3943ba9e416b9c572402aeb8bd53ff172007f55938751378d6"}
Jul 25 02:05:37.269778 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:37.269749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:37.396679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:37.396602    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca\") pod \"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed\" (UID: \"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed\") "
Jul 25 02:05:37.396952 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:37.396922    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" (UID: "2f8f676c-19a5-4ca9-adb3-cfbd54b591ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:05:37.497606 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:37.497577    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:38.143219 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:38.143184    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"
Jul 25 02:05:38.143392 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:38.143212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj" event={"ID":"2f8f676c-19a5-4ca9-adb3-cfbd54b591ed","Type":"ContainerDied","Data":"39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42"}
Jul 25 02:05:38.143392 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:38.143265    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39f23c39dff1516f0c88b38eadfc3dffee5c9ecf43daf6d7a4aaf3eb327bec42"
Jul 25 02:05:44.760160 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.760120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:44.791189 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.791155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:05:44.791416 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.791388    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" podUID="104aff25-b4ff-451e-9647-57cf03b8930d" containerName="payload-processing" containerID="cri-o://aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e" gracePeriod=30
Jul 25 02:05:44.799234 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.799205    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:05:44.799473 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.799447    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" podUID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" containerName="payload-pre-processing" containerID="cri-o://a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6" gracePeriod=30
Jul 25 02:05:44.828366 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.828336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:44.885419 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:44.885384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:45.070934 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.070913    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:05:45.107540 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.107496    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:05:45.168772 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.168739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bxft\" (UniqueName: \"kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft\") pod \"104aff25-b4ff-451e-9647-57cf03b8930d\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") "
Jul 25 02:05:45.168961 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.168850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume\") pod \"104aff25-b4ff-451e-9647-57cf03b8930d\" (UID: \"104aff25-b4ff-451e-9647-57cf03b8930d\") "
Jul 25 02:05:45.169168 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.169147    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "104aff25-b4ff-451e-9647-57cf03b8930d" (UID: "104aff25-b4ff-451e-9647-57cf03b8930d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:05:45.170767 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.170746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft" (OuterVolumeSpecName: "kube-api-access-7bxft") pod "104aff25-b4ff-451e-9647-57cf03b8930d" (UID: "104aff25-b4ff-451e-9647-57cf03b8930d"). InnerVolumeSpecName "kube-api-access-7bxft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:05:45.180551 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.180526    2565 generic.go:356] "Generic (PLEG): container finished" podID="104aff25-b4ff-451e-9647-57cf03b8930d" containerID="aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e" exitCode=0
Jul 25 02:05:45.180675 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.180568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"
Jul 25 02:05:45.180675 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.180609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" event={"ID":"104aff25-b4ff-451e-9647-57cf03b8930d","Type":"ContainerDied","Data":"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"}
Jul 25 02:05:45.180775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.180674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87" event={"ID":"104aff25-b4ff-451e-9647-57cf03b8930d","Type":"ContainerDied","Data":"e90211dcdc3d9260adeada5bc8d7d14f4fec16c5896d424b3f9de73fb7184eea"}
Jul 25 02:05:45.180775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.180706    2565 scope.go:117] "RemoveContainer" containerID="aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"
Jul 25 02:05:45.181869 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.181848    2565 generic.go:356] "Generic (PLEG): container finished" podID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" containerID="a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6" exitCode=0
Jul 25 02:05:45.181985 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.181887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" event={"ID":"14aaf5e8-ba35-4f27-83f7-318aa69ca750","Type":"ContainerDied","Data":"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"}
Jul 25 02:05:45.181985 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.181893    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"
Jul 25 02:05:45.181985 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.181923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r" event={"ID":"14aaf5e8-ba35-4f27-83f7-318aa69ca750","Type":"ContainerDied","Data":"4bd25a599e65b80a6907c64b225df02bb1e4ad3ea939d7d6640b1a06a3d1b851"}
Jul 25 02:05:45.189778 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.189764    2565 scope.go:117] "RemoveContainer" containerID="aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"
Jul 25 02:05:45.190028 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:05:45.190010    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e\": container with ID starting with aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e not found: ID does not exist" containerID="aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"
Jul 25 02:05:45.190107 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.190038    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e"} err="failed to get container status \"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e\": rpc error: code = NotFound desc = could not find container \"aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e\": container with ID starting with aed45b57e378ceb62c2315801fafc1433fc53905bc121bfb4dbec0085bcc8a5e not found: ID does not exist"
Jul 25 02:05:45.190107 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.190060    2565 scope.go:117] "RemoveContainer" containerID="a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"
Jul 25 02:05:45.197529 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.197492    2565 scope.go:117] "RemoveContainer" containerID="a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"
Jul 25 02:05:45.198408 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:05:45.198374    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6\": container with ID starting with a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6 not found: ID does not exist" containerID="a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"
Jul 25 02:05:45.198544 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.198405    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6"} err="failed to get container status \"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6\": rpc error: code = NotFound desc = could not find container \"a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6\": container with ID starting with a42226c2be16ed51b2deadebf309bce39c263aeb1b95fccbc7a1b6a5e77de4d6 not found: ID does not exist"
Jul 25 02:05:45.200991 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.200968    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:05:45.206304 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.206284    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c13f56-59cb956f8-qbk87"]
Jul 25 02:05:45.269821 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.269805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume\") pod \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") "
Jul 25 02:05:45.269941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.269929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmf69\" (UniqueName: \"kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69\") pod \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\" (UID: \"14aaf5e8-ba35-4f27-83f7-318aa69ca750\") "
Jul 25 02:05:45.270125 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.270107    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14aaf5e8-ba35-4f27-83f7-318aa69ca750" (UID: "14aaf5e8-ba35-4f27-83f7-318aa69ca750"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:05:45.270164 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.270150    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bxft\" (UniqueName: \"kubernetes.io/projected/104aff25-b4ff-451e-9647-57cf03b8930d-kube-api-access-7bxft\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:45.270199 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.270164    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104aff25-b4ff-451e-9647-57cf03b8930d-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:45.271872 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.271849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69" (OuterVolumeSpecName: "kube-api-access-nmf69") pod "14aaf5e8-ba35-4f27-83f7-318aa69ca750" (UID: "14aaf5e8-ba35-4f27-83f7-318aa69ca750"). InnerVolumeSpecName "kube-api-access-nmf69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:05:45.371568 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.371545    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14aaf5e8-ba35-4f27-83f7-318aa69ca750-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:45.371568 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.371566    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmf69\" (UniqueName: \"kubernetes.io/projected/14aaf5e8-ba35-4f27-83f7-318aa69ca750-kube-api-access-nmf69\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:45.502136 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.502110    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:05:45.507516 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.507488    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c13f56-864cb89644-vhr5r"]
Jul 25 02:05:45.645696 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.645614    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="104aff25-b4ff-451e-9647-57cf03b8930d" path="/var/lib/kubelet/pods/104aff25-b4ff-451e-9647-57cf03b8930d/volumes"
Jul 25 02:05:45.646014 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:45.646001    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" path="/var/lib/kubelet/pods/14aaf5e8-ba35-4f27-83f7-318aa69ca750/volumes"
Jul 25 02:05:49.439322 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:49.439285    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"]
Jul 25 02:05:49.441409 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:49.441382    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c13f56-4jhlj"]
Jul 25 02:05:49.486027 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:49.485981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:49.646994 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:49.646962    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" path="/var/lib/kubelet/pods/2f8f676c-19a5-4ca9-adb3-cfbd54b591ed/volumes"
Jul 25 02:05:49.854992 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:49.854960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:55.603836 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:55.603807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:55.660735 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:55.660692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:55.843488 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:55.843456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:05:55.843737 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:55.843713    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" containerID="cri-o://44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f" gracePeriod=30
Jul 25 02:05:55.855415 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:55.855335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:56.087881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.087847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:05:56.212729 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.212641    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"]
Jul 25 02:05:56.213063 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213050    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="104aff25-b4ff-451e-9647-57cf03b8930d" containerName="payload-processing"
Jul 25 02:05:56.213063 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213064    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="104aff25-b4ff-451e-9647-57cf03b8930d" containerName="payload-processing"
Jul 25 02:05:56.213149 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213085    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" containerName="revoke-keys"
Jul 25 02:05:56.213149 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213090    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" containerName="revoke-keys"
Jul 25 02:05:56.213149 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213103    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" containerName="payload-pre-processing"
Jul 25 02:05:56.213149 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213109    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" containerName="payload-pre-processing"
Jul 25 02:05:56.213277 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213219    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aaf5e8-ba35-4f27-83f7-318aa69ca750" containerName="payload-pre-processing"
Jul 25 02:05:56.213277 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213231    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="104aff25-b4ff-451e-9647-57cf03b8930d" containerName="payload-processing"
Jul 25 02:05:56.213277 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.213243    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f8f676c-19a5-4ca9-adb3-cfbd54b591ed" containerName="revoke-keys"
Jul 25 02:05:56.218319 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.218302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:56.220546 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.220498    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 02:05:56.220677 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.220499    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cjsrv\""
Jul 25 02:05:56.223196 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.223173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"]
Jul 25 02:05:56.283831 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.283805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7\" (UID: \"13e78af2-5924-47eb-a35b-af1d62ed8a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:56.384644 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.384611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7\" (UID: \"13e78af2-5924-47eb-a35b-af1d62ed8a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:56.385238 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.385218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7\" (UID: \"13e78af2-5924-47eb-a35b-af1d62ed8a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:56.531093 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.531008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:56.669852 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:56.669825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"]
Jul 25 02:05:56.671800 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:05:56.671767    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e78af2_5924_47eb_a35b_af1d62ed8a9c.slice/crio-28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d WatchSource:0}: Error finding container 28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d: Status 404 returned error can't find the container with id 28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d
Jul 25 02:05:57.250787 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:57.250688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7" event={"ID":"13e78af2-5924-47eb-a35b-af1d62ed8a9c","Type":"ContainerStarted","Data":"f2e8108a9d67cc5982041f5b7f3495436e4b1329862a0632755b11542f7bc83c"}
Jul 25 02:05:57.250787 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:57.250750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7" event={"ID":"13e78af2-5924-47eb-a35b-af1d62ed8a9c","Type":"ContainerStarted","Data":"28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d"}
Jul 25 02:05:57.264021 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:57.263943    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7" podStartSLOduration=1.263916488 podStartE2EDuration="1.263916488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:05:57.263916349 +0000 UTC m=+3276.166561362" watchObservedRunningTime="2026-07-25 02:05:57.263916488 +0000 UTC m=+3276.166561501"
Jul 25 02:05:58.257284 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:58.257250    2565 generic.go:356] "Generic (PLEG): container finished" podID="13e78af2-5924-47eb-a35b-af1d62ed8a9c" containerID="f2e8108a9d67cc5982041f5b7f3495436e4b1329862a0632755b11542f7bc83c" exitCode=0
Jul 25 02:05:58.257709 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:58.257332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7" event={"ID":"13e78af2-5924-47eb-a35b-af1d62ed8a9c","Type":"ContainerDied","Data":"f2e8108a9d67cc5982041f5b7f3495436e4b1329862a0632755b11542f7bc83c"}
Jul 25 02:05:59.398081 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.398059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:05:59.515668 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.515597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca\") pod \"13e78af2-5924-47eb-a35b-af1d62ed8a9c\" (UID: \"13e78af2-5924-47eb-a35b-af1d62ed8a9c\") "
Jul 25 02:05:59.515925 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.515906    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13e78af2-5924-47eb-a35b-af1d62ed8a9c" (UID: "13e78af2-5924-47eb-a35b-af1d62ed8a9c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:05:59.616451 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.616428    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13e78af2-5924-47eb-a35b-af1d62ed8a9c-maas-api-service-ca\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:05:59.867570 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.867538    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 02:05:59.867727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:05:59.867597    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 02:06:00.269454 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:00.269374    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"
Jul 25 02:06:00.269611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:00.269370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7" event={"ID":"13e78af2-5924-47eb-a35b-af1d62ed8a9c","Type":"ContainerDied","Data":"28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d"}
Jul 25 02:06:00.269611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:00.269490    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28569134ffb2c801c301c03d9e8d69261f0d83eabeb0d1085854fdf3f7b3458d"
Jul 25 02:06:01.097086 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.097057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:06:01.229378 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229378 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229574 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229574 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229680 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229680 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcvnw\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229680 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:01.229840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:01.229840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.229840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:06:01.229840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data\") pod \"f7053e3c-5730-4e33-9443-10b4e80b4969\" (UID: \"f7053e3c-5730-4e33-9443-10b4e80b4969\") "
Jul 25 02:06:01.230102 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.229899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:01.230234 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.230211    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7053e3c-5730-4e33-9443-10b4e80b4969-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.230295 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.230234    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.230295 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.230249    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.230295 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.230262    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.230572 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.230554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:01.231769 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.231740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:06:01.231880 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.231811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:01.232113 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.232087    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw" (OuterVolumeSpecName: "kube-api-access-xcvnw") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "kube-api-access-xcvnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:06:01.232209 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.232121    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7053e3c-5730-4e33-9443-10b4e80b4969" (UID: "f7053e3c-5730-4e33-9443-10b4e80b4969"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:06:01.276295 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.276267    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerID="44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f" exitCode=0
Jul 25 02:06:01.276409 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.276301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerDied","Data":"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"}
Jul 25 02:06:01.276409 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.276316    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"
Jul 25 02:06:01.276409 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.276337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt" event={"ID":"f7053e3c-5730-4e33-9443-10b4e80b4969","Type":"ContainerDied","Data":"88ea5255d45730bc57e309ff4eeafdc7bf43b7f560f656258facf29667f1186c"}
Jul 25 02:06:01.276409 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.276359    2565 scope.go:117] "RemoveContainer" containerID="44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"
Jul 25 02:06:01.285360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.285345    2565 scope.go:117] "RemoveContainer" containerID="9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"
Jul 25 02:06:01.293276 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.293260    2565 scope.go:117] "RemoveContainer" containerID="44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"
Jul 25 02:06:01.293613 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:06:01.293591    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f\": container with ID starting with 44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f not found: ID does not exist" containerID="44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"
Jul 25 02:06:01.293696 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.293620    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f"} err="failed to get container status \"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f\": rpc error: code = NotFound desc = could not find container \"44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f\": container with ID starting with 44ea1379337146010f79bde938106cd3ab1e46c7ca0a3228ddc24d61cd5c988f not found: ID does not exist"
Jul 25 02:06:01.293696 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.293637    2565 scope.go:117] "RemoveContainer" containerID="9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"
Jul 25 02:06:01.293947 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:06:01.293901    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8\": container with ID starting with 9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8 not found: ID does not exist" containerID="9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"
Jul 25 02:06:01.294017 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.293956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8"} err="failed to get container status \"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8\": rpc error: code = NotFound desc = could not find container \"9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8\": container with ID starting with 9ba2094b90722481464ac9ec7b347949d56b908eced794667569a03ee1fd45c8 not found: ID does not exist"
Jul 25 02:06:01.296580 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.296561    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:06:01.299873 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.299853    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c13f56-openshift-default-69bf45fc86-9tfjt"]
Jul 25 02:06:01.331002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.330983    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.331002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.331001    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.331113 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.331010    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.331113 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.331019    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7053e3c-5730-4e33-9443-10b4e80b4969-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.331113 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.331026    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcvnw\" (UniqueName: \"kubernetes.io/projected/f7053e3c-5730-4e33-9443-10b4e80b4969-kube-api-access-xcvnw\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:01.651400 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:01.651368    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" path="/var/lib/kubelet/pods/f7053e3c-5730-4e33-9443-10b4e80b4969/volumes"
Jul 25 02:06:06.732629 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:06.732596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:06.805044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:06.805008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:06.866113 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:06.866077    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:09.805316 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:09.805289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:11.276888 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:11.276854    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"]
Jul 25 02:06:11.281438 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:11.281414    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a3abd-mzcm7"]
Jul 25 02:06:11.283786 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:11.283752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:11.646255 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:11.646223    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e78af2-5924-47eb-a35b-af1d62ed8a9c" path="/var/lib/kubelet/pods/13e78af2-5924-47eb-a35b-af1d62ed8a9c/volumes"
Jul 25 02:06:11.675315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:11.675287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:17.456130 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.456096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:17.510365 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.510337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:17.700570 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.700526    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:06:17.700798 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.700770    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" containerID="cri-o://c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe" gracePeriod=30
Jul 25 02:06:17.714335 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.714265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:17.954863 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:17.954828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:18.291106 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.291071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:18.568826 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.568736    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:06:18.569343 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:18.569497 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569346    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:18.569497 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569374    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e78af2-5924-47eb-a35b-af1d62ed8a9c" containerName="revoke-keys"
Jul 25 02:06:18.569497 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569383    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e78af2-5924-47eb-a35b-af1d62ed8a9c" containerName="revoke-keys"
Jul 25 02:06:18.569497 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569399    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:18.569497 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569407    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:18.569775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569551    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:18.569775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.569566    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e78af2-5924-47eb-a35b-af1d62ed8a9c" containerName="revoke-keys"
Jul 25 02:06:18.573084 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.573065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.578470 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.578453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a9b5fd-openshift-default-dockercfg-lczct\""
Jul 25 02:06:18.588108 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.588087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:06:18.601258 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.601222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:18.686102 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v2gc\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686583 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686583 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.686583 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.686440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788009 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.787975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788159 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788159 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788159 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788159 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v2gc\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788360 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788612 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788813 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.788951 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.788935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.790379 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.790362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.790714 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.790697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.794786 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.794762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.794988 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.794970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v2gc\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc\") pod \"e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") " pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.883327 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.883302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:18.952013 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:18.951896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:19.022020 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.021992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:06:19.024111 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:06:19.024086    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155202b5_18e9_4e2b_b310_6826f6191467.slice/crio-60a08c39897abce99ec5c9a2e243d6764edf187f107addbfa556146aa42a2700 WatchSource:0}: Error finding container 60a08c39897abce99ec5c9a2e243d6764edf187f107addbfa556146aa42a2700: Status 404 returned error can't find the container with id 60a08c39897abce99ec5c9a2e243d6764edf187f107addbfa556146aa42a2700
Jul 25 02:06:19.026323 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.026268    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:19.026413 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.026354    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:19.026413 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.026379    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:19.377538 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.377495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerStarted","Data":"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"}
Jul 25 02:06:19.377699 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.377559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerStarted","Data":"60a08c39897abce99ec5c9a2e243d6764edf187f107addbfa556146aa42a2700"}
Jul 25 02:06:19.396555 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.396487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podStartSLOduration=1.3964720339999999 podStartE2EDuration="1.396472034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:19.39383631 +0000 UTC m=+3298.296481360" watchObservedRunningTime="2026-07-25 02:06:19.396472034 +0000 UTC m=+3298.299117243"
Jul 25 02:06:19.883590 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:19.883559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:20.889246 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:20.889219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:21.019646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.019612    2565 patch_prober.go:28] interesting pod/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 02:06:21.019797 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.019676    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 02:06:21.343865 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.343829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:21.395421 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.395386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:21.396261 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.396241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:21.439293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.439257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:21.507399 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.507362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:21.749905 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:21.749807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:22.089575 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:22.089544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:22.179120 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:22.179084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:22.957863 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:22.957841    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:06:23.130009 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.129976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130009 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bmcx\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket\") pod \"de905158-4374-4877-85fc-e06f70b70051\" (UID: \"de905158-4374-4877-85fc-e06f70b70051\") "
Jul 25 02:06:23.130943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:06:23.130943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130739    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de905158-4374-4877-85fc-e06f70b70051-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.130943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130816    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:23.130943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130835    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:23.130943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.130934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:23.131330 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.131311    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data" (OuterVolumeSpecName: "istio-data") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:23.132359 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.132327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:06:23.132488 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.132373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token" (OuterVolumeSpecName: "istio-token") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:06:23.132694 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.132667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx" (OuterVolumeSpecName: "kube-api-access-6bmcx") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "kube-api-access-6bmcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:06:23.132694 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.132685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de905158-4374-4877-85fc-e06f70b70051" (UID: "de905158-4374-4877-85fc-e06f70b70051"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:06:23.231458 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231428    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231458 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231453    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de905158-4374-4877-85fc-e06f70b70051-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231458 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231462    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231470    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231479    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231488    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de905158-4374-4877-85fc-e06f70b70051-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231495    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.231686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.231524    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bmcx\" (UniqueName: \"kubernetes.io/projected/de905158-4374-4877-85fc-e06f70b70051-kube-api-access-6bmcx\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:06:23.408286 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.408201    2565 generic.go:356] "Generic (PLEG): container finished" podID="de905158-4374-4877-85fc-e06f70b70051" containerID="c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe" exitCode=0
Jul 25 02:06:23.408286 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.408256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"
Jul 25 02:06:23.408525 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.408334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerDied","Data":"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"}
Jul 25 02:06:23.408525 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.408396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q" event={"ID":"de905158-4374-4877-85fc-e06f70b70051","Type":"ContainerDied","Data":"899f247aa9e8a7548714b8416f9b1efbc0ae5d84c12c5f272abf86e68afd5d71"}
Jul 25 02:06:23.408525 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.408426    2565 scope.go:117] "RemoveContainer" containerID="c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"
Jul 25 02:06:23.417874 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.417859    2565 scope.go:117] "RemoveContainer" containerID="26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"
Jul 25 02:06:23.425542 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.425501    2565 scope.go:117] "RemoveContainer" containerID="c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"
Jul 25 02:06:23.425775 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:06:23.425759    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe\": container with ID starting with c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe not found: ID does not exist" containerID="c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"
Jul 25 02:06:23.425826 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.425783    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe"} err="failed to get container status \"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe\": rpc error: code = NotFound desc = could not find container \"c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe\": container with ID starting with c6da480023a08c11a77064d7a764e274430b8c4a0a7ccd4433934b74e7be9bfe not found: ID does not exist"
Jul 25 02:06:23.425826 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.425799    2565 scope.go:117] "RemoveContainer" containerID="26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"
Jul 25 02:06:23.426686 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:06:23.426113    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61\": container with ID starting with 26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61 not found: ID does not exist" containerID="26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"
Jul 25 02:06:23.426686 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.426154    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61"} err="failed to get container status \"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61\": rpc error: code = NotFound desc = could not find container \"26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61\": container with ID starting with 26caa1af78f4b4dcbaee81d8815e80a6fca85cb31e3eebb6e76eb85c15f76d61 not found: ID does not exist"
Jul 25 02:06:23.428802 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.428782    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:06:23.432205 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.432186    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1a3abd-openshift-default-67b67658fb-dtp4q"]
Jul 25 02:06:23.647581 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:23.647551    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de905158-4374-4877-85fc-e06f70b70051" path="/var/lib/kubelet/pods/de905158-4374-4877-85fc-e06f70b70051/volumes"
Jul 25 02:06:25.869120 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:25.869083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:26.339012 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.338980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:26.604690 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.604602    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:06:26.605040 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605022    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.605040 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605037    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.605278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605051    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.605278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605060    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.605278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605164    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7053e3c-5730-4e33-9443-10b4e80b4969" containerName="istio-proxy"
Jul 25 02:06:26.605278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605180    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.605278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.605193    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de905158-4374-4877-85fc-e06f70b70051" containerName="istio-proxy"
Jul 25 02:06:26.609763 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.609744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.611650 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.611633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6fd1ef-openshift-default-dockercfg-9g5rv\""
Jul 25 02:06:26.620072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.620050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:06:26.633423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.633394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:26.764205 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764395 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764395 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764395 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764395 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764592 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764592 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n52sm\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764592 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.764714 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.764593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865548 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865698 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865698 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865698 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865872 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865872 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n52sm\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.865872 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866027 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.865887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866079 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866079 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866203 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866469 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.866571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.866555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.868187 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.868168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.868293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.868262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.872562 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.872539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.872899 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.872746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n52sm\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm\") pod \"e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") " pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:26.888044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.888020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:26.920816 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:26.920797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:27.058609 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.058583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:06:27.060485 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:06:27.060460    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c079d7a_b39f_4330_a561_c387b0bd8842.slice/crio-5b728a56db153e26637a720dd801efd6768d4becc3c0b8bf93f60a203e2f9bdb WatchSource:0}: Error finding container 5b728a56db153e26637a720dd801efd6768d4becc3c0b8bf93f60a203e2f9bdb: Status 404 returned error can't find the container with id 5b728a56db153e26637a720dd801efd6768d4becc3c0b8bf93f60a203e2f9bdb
Jul 25 02:06:27.062718 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.062685    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:27.062794 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.062753    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:27.062794 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.062786    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:27.432133 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.432099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerStarted","Data":"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"}
Jul 25 02:06:27.432315 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.432154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerStarted","Data":"5b728a56db153e26637a720dd801efd6768d4becc3c0b8bf93f60a203e2f9bdb"}
Jul 25 02:06:27.450528 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.450454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podStartSLOduration=1.45043728 podStartE2EDuration="1.45043728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:27.449418461 +0000 UTC m=+3306.352063473" watchObservedRunningTime="2026-07-25 02:06:27.45043728 +0000 UTC m=+3306.353082292"
Jul 25 02:06:27.921488 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:27.921456    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:28.926794 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:28.926765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:29.329068 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:29.328951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:29.434799 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:29.434767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:29.446008 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:29.445979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:29.448221 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:29.448200    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:29.670076 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:29.670028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:30.085147 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.085108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:30.188239 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.188193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:30.236813 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.236776    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:06:30.240543 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.240502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.242597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.242580    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-6fd1ef\""
Jul 25 02:06:30.242722 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.242664    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-6fd1ef-dockercfg-rgmsr\""
Jul 25 02:06:30.252324 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.251148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:06:30.265657 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.265630    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:06:30.269157 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.269135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.299220 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.299186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztfdl\" (UniqueName: \"kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.299369 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.299342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.299454 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.299424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.299611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.299526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chwtc\" (UniqueName: \"kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.307540 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.305875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:30.309936 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.309908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:06:30.401309 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.401189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.401309 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.401283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.401623 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.401342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chwtc\" (UniqueName: \"kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.401623 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.401379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztfdl\" (UniqueName: \"kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.402538 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.402469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.402718 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.402643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.409257 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.409238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chwtc\" (UniqueName: \"kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc\") pod \"payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") " pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.409404 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.409341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztfdl\" (UniqueName: \"kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl\") pod \"payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.554096 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.554065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:30.605815 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.605777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:30.764242 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.764219    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:06:30.765486 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:06:30.765461    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126bd490_f676_4a99_a906_a4b17104d451.slice/crio-4ec5237b405d76d4521871652cfe5411aae6403bae1dac95638f5790157b34c0 WatchSource:0}: Error finding container 4ec5237b405d76d4521871652cfe5411aae6403bae1dac95638f5790157b34c0: Status 404 returned error can't find the container with id 4ec5237b405d76d4521871652cfe5411aae6403bae1dac95638f5790157b34c0
Jul 25 02:06:30.802685 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:30.802641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:06:30.805458 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:06:30.805424    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0f78ae_c959_4f7a_bf19_03afa6d77b0f.slice/crio-c164a6673c8b74b84b0537a79dfe035f508e75ac8c1cd2e305fb8307a66054de WatchSource:0}: Error finding container c164a6673c8b74b84b0537a79dfe035f508e75ac8c1cd2e305fb8307a66054de: Status 404 returned error can't find the container with id c164a6673c8b74b84b0537a79dfe035f508e75ac8c1cd2e305fb8307a66054de
Jul 25 02:06:31.459522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.459475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" event={"ID":"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f","Type":"ContainerStarted","Data":"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"}
Jul 25 02:06:31.459947 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.459553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" event={"ID":"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f","Type":"ContainerStarted","Data":"c164a6673c8b74b84b0537a79dfe035f508e75ac8c1cd2e305fb8307a66054de"}
Jul 25 02:06:31.459947 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.459582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:31.461119 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.461091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" event={"ID":"126bd490-f676-4a99-a906-a4b17104d451","Type":"ContainerStarted","Data":"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"}
Jul 25 02:06:31.461197 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.461139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" event={"ID":"126bd490-f676-4a99-a906-a4b17104d451","Type":"ContainerStarted","Data":"4ec5237b405d76d4521871652cfe5411aae6403bae1dac95638f5790157b34c0"}
Jul 25 02:06:31.461324 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.461307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:31.474464 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.474424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" podStartSLOduration=1.474410996 podStartE2EDuration="1.474410996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:31.473345746 +0000 UTC m=+3310.375990759" watchObservedRunningTime="2026-07-25 02:06:31.474410996 +0000 UTC m=+3310.377056008"
Jul 25 02:06:31.488269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:31.488217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" podStartSLOduration=1.488200382 podStartE2EDuration="1.488200382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:31.487793249 +0000 UTC m=+3310.390438262" watchObservedRunningTime="2026-07-25 02:06:31.488200382 +0000 UTC m=+3310.390845398"
Jul 25 02:06:33.822708 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:33.822659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:36.466492 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.465606    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:51692->10.134.0.64:15021: read: connection reset by peer" start-of-body=
Jul 25 02:06:36.466492 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.465679    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:51692->10.134.0.64:15021: read: connection reset by peer"
Jul 25 02:06:36.497384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.497359    2565 generic.go:356] "Generic (PLEG): container finished" podID="155202b5-18e9-4e2b-b310-6826f6191467" containerID="546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34" exitCode=0
Jul 25 02:06:36.497502 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.497438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerDied","Data":"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"}
Jul 25 02:06:36.497848 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.497833    2565 scope.go:117] "RemoveContainer" containerID="546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"
Jul 25 02:06:36.499063 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.499029    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:36.499139 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.499122    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:36.499209 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:36.499194    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:37.504883 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:37.504850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerStarted","Data":"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"}
Jul 25 02:06:37.884778 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:37.884735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:37.885114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:37.884871    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 25 02:06:37.885114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:37.884913    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 25 02:06:38.884571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:38.884531    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 25 02:06:38.885070 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:38.884609    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 25 02:06:39.884430 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:39.883970    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 25 02:06:39.884430 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:39.884036    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 25 02:06:40.884597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:40.884129    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 25 02:06:40.884597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:40.884194    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 25 02:06:41.895293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:41.895261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:41.896838 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:41.896819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:41.898661 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:41.898642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:06:42.471715 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:42.471681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:06:42.471904 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:42.471770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:06:45.471881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.471789    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 02:06:45.472216 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.471874    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 02:06:45.560924 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.560896    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerID="aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff" exitCode=0
Jul 25 02:06:45.561073 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.560973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerDied","Data":"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"}
Jul 25 02:06:45.561397 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.561382    2565 scope.go:117] "RemoveContainer" containerID="aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"
Jul 25 02:06:45.562448 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.562419    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:45.562526 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.562489    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:45.562571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:45.562543    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:06:46.568581 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:46.568546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerStarted","Data":"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"}
Jul 25 02:06:46.921551 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:46.921495    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:46.921735 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:46.921716    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 25 02:06:46.921794 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:46.921761    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 25 02:06:47.921138 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:47.921110    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 25 02:06:47.921538 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:47.921157    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 25 02:06:48.921529 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:48.921479    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 25 02:06:48.921919 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:48.921560    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 25 02:06:49.921784 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:49.921746    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 25 02:06:49.922263 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:49.921807    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 25 02:06:50.924495 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:50.924465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:50.924976 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:50.924767    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:50.925661 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:50.925643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:06:56.974442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:56.974405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:57.049755 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:57.049683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:06:57.111359 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:06:57.111324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:01.851111 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:01.851072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:02.251456 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:02.251365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:07.936984 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:07.936949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:08.037857 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:08.037815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:08.163668 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:08.163637    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:07:08.163917 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:08.163888    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" containerID="cri-o://cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea" gracePeriod=30
Jul 25 02:07:08.183257 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:08.183223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:08.410826 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:08.410794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:11.899155 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:11.899118    2565 patch_prober.go:28] interesting pod/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 02:07:11.899568 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:11.899190    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 02:07:13.424712 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.424651    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:07:13.453956 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.453924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454115 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.453965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454115 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.453981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454115 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454011    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454115 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454341 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454341 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454196    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454341 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454341 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454271    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:13.454341 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v2gc\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc\") pod \"155202b5-18e9-4e2b-b310-6826f6191467\" (UID: \"155202b5-18e9-4e2b-b310-6826f6191467\") "
Jul 25 02:07:13.454627 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:13.454627 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:07:13.454742 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454723    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.454849 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454749    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155202b5-18e9-4e2b-b310-6826f6191467-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.454849 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454828    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.454941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.454868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:13.455671 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.455645    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data" (OuterVolumeSpecName: "istio-data") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:13.456412 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.456385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token" (OuterVolumeSpecName: "istio-token") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:13.456599 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.456566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc" (OuterVolumeSpecName: "kube-api-access-4v2gc") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "kube-api-access-4v2gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:13.456712 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.456633    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:13.456910 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.456895    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "155202b5-18e9-4e2b-b310-6826f6191467" (UID: "155202b5-18e9-4e2b-b310-6826f6191467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:07:13.556314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556266    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155202b5-18e9-4e2b-b310-6826f6191467-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.556314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556309    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.556314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556318    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.556314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556328    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v2gc\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-kube-api-access-4v2gc\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.556633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556339    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155202b5-18e9-4e2b-b310-6826f6191467-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.556633 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.556347    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155202b5-18e9-4e2b-b310-6826f6191467-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:13.723199 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.723116    2565 generic.go:356] "Generic (PLEG): container finished" podID="155202b5-18e9-4e2b-b310-6826f6191467" containerID="cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea" exitCode=0
Jul 25 02:07:13.723199 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.723163    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"
Jul 25 02:07:13.723383 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.723198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerDied","Data":"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"}
Jul 25 02:07:13.723383 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.723281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8" event={"ID":"155202b5-18e9-4e2b-b310-6826f6191467","Type":"ContainerDied","Data":"60a08c39897abce99ec5c9a2e243d6764edf187f107addbfa556146aa42a2700"}
Jul 25 02:07:13.723383 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.723308    2565 scope.go:117] "RemoveContainer" containerID="cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"
Jul 25 02:07:13.732636 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.732620    2565 scope.go:117] "RemoveContainer" containerID="546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"
Jul 25 02:07:13.739042 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.739018    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:07:13.741044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.741021    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a9b5fd-openshift-default-86b89c65c4-5c5n8"]
Jul 25 02:07:13.742221 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.742208    2565 scope.go:117] "RemoveContainer" containerID="cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"
Jul 25 02:07:13.742560 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:13.742542    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea\": container with ID starting with cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea not found: ID does not exist" containerID="cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"
Jul 25 02:07:13.742613 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.742569    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea"} err="failed to get container status \"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea\": rpc error: code = NotFound desc = could not find container \"cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea\": container with ID starting with cc71b7cd13b8f1776cd9131036894b8b287a1095b0f26772fd370c76592ec6ea not found: ID does not exist"
Jul 25 02:07:13.742613 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.742588    2565 scope.go:117] "RemoveContainer" containerID="546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"
Jul 25 02:07:13.742825 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:13.742807    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34\": container with ID starting with 546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34 not found: ID does not exist" containerID="546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"
Jul 25 02:07:13.742881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:13.742834    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34"} err="failed to get container status \"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34\": rpc error: code = NotFound desc = could not find container \"546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34\": container with ID starting with 546545916c308f2db67b0e6a86f0a75e2e196e07a80db7fc44279e66ef464e34 not found: ID does not exist"
Jul 25 02:07:15.645976 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:15.645943    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="155202b5-18e9-4e2b-b310-6826f6191467" path="/var/lib/kubelet/pods/155202b5-18e9-4e2b-b310-6826f6191467/volumes"
Jul 25 02:07:22.109006 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:22.108972    2565 scope.go:117] "RemoveContainer" containerID="4c23ad01b1389abe43fe287c98525596a79788362fb2c24dccb3f00295581dbf"
Jul 25 02:07:23.938991 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:23.938944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:23.967266 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:23.967234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:07:23.967520 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:23.967479    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" podUID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" containerName="payload-processing" containerID="cri-o://18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47" gracePeriod=30
Jul 25 02:07:23.974747 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:23.974290    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:07:23.974747 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:23.974636    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" podUID="126bd490-f676-4a99-a906-a4b17104d451" containerName="payload-pre-processing" containerID="cri-o://40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98" gracePeriod=30
Jul 25 02:07:24.004277 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.004243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:24.065373 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.065338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:24.248852 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.248828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:07:24.252010 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.251989    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:07:24.367674 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.367625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztfdl\" (UniqueName: \"kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl\") pod \"126bd490-f676-4a99-a906-a4b17104d451\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") "
Jul 25 02:07:24.367674 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.367697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chwtc\" (UniqueName: \"kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc\") pod \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") "
Jul 25 02:07:24.367918 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.367777    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume\") pod \"126bd490-f676-4a99-a906-a4b17104d451\" (UID: \"126bd490-f676-4a99-a906-a4b17104d451\") "
Jul 25 02:07:24.367918 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.367826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume\") pod \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\" (UID: \"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f\") "
Jul 25 02:07:24.368221 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.368189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "126bd490-f676-4a99-a906-a4b17104d451" (UID: "126bd490-f676-4a99-a906-a4b17104d451"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:07:24.368345 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.368237    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" (UID: "0a0f78ae-c959-4f7a-bf19-03afa6d77b0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:07:24.369821 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.369801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl" (OuterVolumeSpecName: "kube-api-access-ztfdl") pod "126bd490-f676-4a99-a906-a4b17104d451" (UID: "126bd490-f676-4a99-a906-a4b17104d451"). InnerVolumeSpecName "kube-api-access-ztfdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:24.369881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.369865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc" (OuterVolumeSpecName: "kube-api-access-chwtc") pod "0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" (UID: "0a0f78ae-c959-4f7a-bf19-03afa6d77b0f"). InnerVolumeSpecName "kube-api-access-chwtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:24.468871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.468829    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/126bd490-f676-4a99-a906-a4b17104d451-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:24.468871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.468866    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:24.468871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.468875    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztfdl\" (UniqueName: \"kubernetes.io/projected/126bd490-f676-4a99-a906-a4b17104d451-kube-api-access-ztfdl\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:24.468871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.468883    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chwtc\" (UniqueName: \"kubernetes.io/projected/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f-kube-api-access-chwtc\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:24.783413 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.783380    2565 generic.go:356] "Generic (PLEG): container finished" podID="126bd490-f676-4a99-a906-a4b17104d451" containerID="40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98" exitCode=0
Jul 25 02:07:24.783646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.783438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"
Jul 25 02:07:24.783646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.783466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" event={"ID":"126bd490-f676-4a99-a906-a4b17104d451","Type":"ContainerDied","Data":"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"}
Jul 25 02:07:24.783646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.783534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv" event={"ID":"126bd490-f676-4a99-a906-a4b17104d451","Type":"ContainerDied","Data":"4ec5237b405d76d4521871652cfe5411aae6403bae1dac95638f5790157b34c0"}
Jul 25 02:07:24.783646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.783558    2565 scope.go:117] "RemoveContainer" containerID="40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"
Jul 25 02:07:24.784844 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.784826    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" containerID="18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47" exitCode=0
Jul 25 02:07:24.784942 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.784872    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"
Jul 25 02:07:24.784942 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.784878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" event={"ID":"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f","Type":"ContainerDied","Data":"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"}
Jul 25 02:07:24.785039 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.784945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m" event={"ID":"0a0f78ae-c959-4f7a-bf19-03afa6d77b0f","Type":"ContainerDied","Data":"c164a6673c8b74b84b0537a79dfe035f508e75ac8c1cd2e305fb8307a66054de"}
Jul 25 02:07:24.793942 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.793925    2565 scope.go:117] "RemoveContainer" containerID="40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"
Jul 25 02:07:24.794238 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:24.794218    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98\": container with ID starting with 40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98 not found: ID does not exist" containerID="40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"
Jul 25 02:07:24.794328 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.794245    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98"} err="failed to get container status \"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98\": rpc error: code = NotFound desc = could not find container \"40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98\": container with ID starting with 40e0a9b8c4bd862c544d44c763584fd70173bc338103d39955a20e54e0a66c98 not found: ID does not exist"
Jul 25 02:07:24.794328 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.794268    2565 scope.go:117] "RemoveContainer" containerID="18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"
Jul 25 02:07:24.803325 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.803305    2565 scope.go:117] "RemoveContainer" containerID="18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"
Jul 25 02:07:24.803657 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:24.803627    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47\": container with ID starting with 18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47 not found: ID does not exist" containerID="18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"
Jul 25 02:07:24.803736 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.803667    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47"} err="failed to get container status \"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47\": rpc error: code = NotFound desc = could not find container \"18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47\": container with ID starting with 18165086c0a37a7237e44c36d122e49c45ccde06edaeb94d50c0624463983e47 not found: ID does not exist"
Jul 25 02:07:24.804678 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.804660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:07:24.810795 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.810774    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6fd1ef-f6f6db84-wcmhv"]
Jul 25 02:07:24.819118 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.819093    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:07:24.822647 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:24.822628    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-6fd1ef-776664788b-j8p5m"]
Jul 25 02:07:25.645962 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:25.645929    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" path="/var/lib/kubelet/pods/0a0f78ae-c959-4f7a-bf19-03afa6d77b0f/volumes"
Jul 25 02:07:25.646339 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:25.646298    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126bd490-f676-4a99-a906-a4b17104d451" path="/var/lib/kubelet/pods/126bd490-f676-4a99-a906-a4b17104d451/volumes"
Jul 25 02:07:28.602314 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:28.602284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:28.991664 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:28.991574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:34.674643 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:34.674611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:34.739834 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:34.739803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:34.942123 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:34.942040    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:07:34.942282 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:34.942237    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" containerID="cri-o://7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139" gracePeriod=30
Jul 25 02:07:34.961007 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:34.960976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:35.191986 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.191946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:35.529437 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.529405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:35.821526 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.821426    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:07:35.822032 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822012    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126bd490-f676-4a99-a906-a4b17104d451" containerName="payload-pre-processing"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="126bd490-f676-4a99-a906-a4b17104d451" containerName="payload-pre-processing"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822066    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822076    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822086    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" containerName="payload-processing"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822096    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" containerName="payload-processing"
Jul 25 02:07:35.822114 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822108    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:35.822406 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822117    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:35.822406 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822229    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="126bd490-f676-4a99-a906-a4b17104d451" containerName="payload-pre-processing"
Jul 25 02:07:35.822406 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822240    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:35.822406 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.822258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0f78ae-c959-4f7a-bf19-03afa6d77b0f" containerName="payload-processing"
Jul 25 02:07:35.825542 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.825524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.827304 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.827286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7e06ec-openshift-default-dockercfg-2ttz6\""
Jul 25 02:07:35.834561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.834539    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:07:35.845110 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.845088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:35.932093 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.932025    2565 patch_prober.go:28] interesting pod/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 02:07:35.932598 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.932546    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 02:07:35.979037 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979215 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979215 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnfw9\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979215 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979215 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:35.979384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:35.979319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.040566 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.040531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:36.080808 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.080785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.080950 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.080828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081023 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnfw9\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081071 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081071 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081175 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081175 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081278 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081619 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.081832 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.082029 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.081836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.083364 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.083344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.083631 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.083612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.087778 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.087753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.088003 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.087986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnfw9\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9\") pod \"e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") " pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.138076 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.138041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:36.272102 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.272079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:07:36.274000 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:07:36.273973    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda083b4ac_09b0_4d78_a528_0f04459ed49d.slice/crio-62614345cdec70ec605f7ef3d04978624b2db4090c23e1106093fa88972563e1 WatchSource:0}: Error finding container 62614345cdec70ec605f7ef3d04978624b2db4090c23e1106093fa88972563e1: Status 404 returned error can't find the container with id 62614345cdec70ec605f7ef3d04978624b2db4090c23e1106093fa88972563e1
Jul 25 02:07:36.276146 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.276113    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:36.276238 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.276178    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:36.276238 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.276210    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:36.848556 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.848522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerStarted","Data":"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"}
Jul 25 02:07:36.848942 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.848580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerStarted","Data":"62614345cdec70ec605f7ef3d04978624b2db4090c23e1106093fa88972563e1"}
Jul 25 02:07:36.866211 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:36.866154    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podStartSLOduration=1.866135459 podStartE2EDuration="1.866135459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:07:36.866090146 +0000 UTC m=+3375.768735157" watchObservedRunningTime="2026-07-25 02:07:36.866135459 +0000 UTC m=+3375.768780473"
Jul 25 02:07:37.138694 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:37.138614    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:37.143739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:37.143717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:37.854238 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:37.854212    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:37.855205 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:37.855185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:38.772613 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:38.772574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:38.875847 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:38.875811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:38.955627 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:38.955598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:39.353729 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:39.353697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:39.458645 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:39.458596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:39.535187 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:39.535155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:40.196813 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.196788    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:07:40.324579 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324477    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324579 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324815 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324815 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324709    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324944 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324819    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324944 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324944 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324892    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n52sm\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.324944 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324933    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.325138 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324956    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:40.325138 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.324980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token\") pod \"6c079d7a-b39f-4330-a561-c387b0bd8842\" (UID: \"6c079d7a-b39f-4330-a561-c387b0bd8842\") "
Jul 25 02:07:40.325138 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:07:40.325455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325404    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c079d7a-b39f-4330-a561-c387b0bd8842-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.325455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:40.325455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325431    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.325773 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:40.325773 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.325602    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:40.326896 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.326871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:07:40.327062 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.327045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:07:40.327628 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.327606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:40.327700 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.327609    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm" (OuterVolumeSpecName: "kube-api-access-n52sm") pod "6c079d7a-b39f-4330-a561-c387b0bd8842" (UID: "6c079d7a-b39f-4330-a561-c387b0bd8842"). InnerVolumeSpecName "kube-api-access-n52sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:07:40.426792 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426758    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.426792 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426784    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.426792 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426794    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n52sm\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-kube-api-access-n52sm\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.427030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426804    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.427030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426813    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.427030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426821    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.427030 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.426828    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c079d7a-b39f-4330-a561-c387b0bd8842-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:07:40.871171 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.871137    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerID="7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139" exitCode=0
Jul 25 02:07:40.871381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.871208    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"
Jul 25 02:07:40.871381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.871234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerDied","Data":"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"}
Jul 25 02:07:40.871381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.871300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2" event={"ID":"6c079d7a-b39f-4330-a561-c387b0bd8842","Type":"ContainerDied","Data":"5b728a56db153e26637a720dd801efd6768d4becc3c0b8bf93f60a203e2f9bdb"}
Jul 25 02:07:40.871381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.871330    2565 scope.go:117] "RemoveContainer" containerID="7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"
Jul 25 02:07:40.880863 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.880847    2565 scope.go:117] "RemoveContainer" containerID="aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"
Jul 25 02:07:40.888697 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.888681    2565 scope.go:117] "RemoveContainer" containerID="7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"
Jul 25 02:07:40.888949 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:40.888931    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139\": container with ID starting with 7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139 not found: ID does not exist" containerID="7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"
Jul 25 02:07:40.888999 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.888956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139"} err="failed to get container status \"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139\": rpc error: code = NotFound desc = could not find container \"7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139\": container with ID starting with 7941dcf2e305b337b32953df712df177b10a0a79d6bb4e1e342bd2492e433139 not found: ID does not exist"
Jul 25 02:07:40.888999 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.888972    2565 scope.go:117] "RemoveContainer" containerID="aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"
Jul 25 02:07:40.889192 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:07:40.889171    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff\": container with ID starting with aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff not found: ID does not exist" containerID="aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"
Jul 25 02:07:40.889254 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.889202    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff"} err="failed to get container status \"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff\": rpc error: code = NotFound desc = could not find container \"aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff\": container with ID starting with aaf129f6e7b03383afa540b36c513f1fe3df63ec186ce339aaa2cb138a632aff not found: ID does not exist"
Jul 25 02:07:40.892211 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.892192    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:07:40.897611 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:40.897591    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6fd1ef-openshift-default-67c9bd969d-t48s2"]
Jul 25 02:07:41.645116 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:41.645085    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" path="/var/lib/kubelet/pods/6c079d7a-b39f-4330-a561-c387b0bd8842/volumes"
Jul 25 02:07:43.233284 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.233251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:43.558527 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.558386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:43.846121 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846088    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:07:43.846676 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846639    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:43.846676 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846660    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:43.846840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846761    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="155202b5-18e9-4e2b-b310-6826f6191467" containerName="istio-proxy"
Jul 25 02:07:43.846840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846776    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:43.846840 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.846784    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:43.851120 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.851103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.853064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.853044    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-575aa7-openshift-default-dockercfg-g757z\""
Jul 25 02:07:43.856293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856582 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l82cf\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856582 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856582 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856735 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.856735 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.856644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.860899 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.860867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:07:43.874560 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.874531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:43.957646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.957833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.957833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.957833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l82cf\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.957833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.957997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.958206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.958225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.958259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958857 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.958822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.958991 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.958887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.960864 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.960844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.961065 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.961048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.965579 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.965552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:43.965733 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:43.965717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l82cf\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf\") pod \"e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") " pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:44.163932 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.163851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:44.189644 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.189601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:44.323446 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.323409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:07:44.326279 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:07:44.326241    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46c358b_1374_497e_a655_0b9a1a0c208a.slice/crio-0645f64313c6b3eea03a0e31193020b68dd8c8f00307088d0119d9dd5cdec5da WatchSource:0}: Error finding container 0645f64313c6b3eea03a0e31193020b68dd8c8f00307088d0119d9dd5cdec5da: Status 404 returned error can't find the container with id 0645f64313c6b3eea03a0e31193020b68dd8c8f00307088d0119d9dd5cdec5da
Jul 25 02:07:44.328604 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.328567    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:44.328675 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.328656    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:44.328717 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.328699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:44.897104 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.897064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerStarted","Data":"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"}
Jul 25 02:07:44.897281 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.897153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerStarted","Data":"0645f64313c6b3eea03a0e31193020b68dd8c8f00307088d0119d9dd5cdec5da"}
Jul 25 02:07:44.917182 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:44.917131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podStartSLOduration=1.917116317 podStartE2EDuration="1.917116317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:07:44.913823281 +0000 UTC m=+3383.816468303" watchObservedRunningTime="2026-07-25 02:07:44.917116317 +0000 UTC m=+3383.819761329"
Jul 25 02:07:45.164820 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:45.164733    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:45.169707 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:45.169674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:45.902190 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:45.902158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:45.903292 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:45.903275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:07:46.822782 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:46.822746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:46.920597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:46.920559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:47.069943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.069910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:47.187293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.187260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:47.524259 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.524160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:47.617111 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.617081    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:07:47.617391 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.617364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:47.617709 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.617681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:47.617709 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.617702    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c079d7a-b39f-4330-a561-c387b0bd8842" containerName="istio-proxy"
Jul 25 02:07:47.621048 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.621026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.622813 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.622792    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-575aa7\""
Jul 25 02:07:47.630528 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.630485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:07:47.655135 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.655101    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:07:47.658557 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.658542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.660287 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.660270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-575aa7-dockercfg-sznb7\""
Jul 25 02:07:47.666727 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.666706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:07:47.694292 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.694264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.694408 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.694360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgnm\" (UniqueName: \"kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.694476 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.694454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj52\" (UniqueName: \"kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.694541 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.694491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.795768 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.795674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj52\" (UniqueName: \"kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.795943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.795791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.795943 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.795863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.796070 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.795967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgnm\" (UniqueName: \"kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.796597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.796576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.796697 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.796577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.807390 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.807356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj52\" (UniqueName: \"kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52\") pod \"payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.807571 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.807523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgnm\" (UniqueName: \"kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm\") pod \"payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:47.932304 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.932266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:47.969873 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:47.969843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:48.147049 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.147021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:07:48.148832 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:07:48.148801    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd606b8a_cdc9_4668_a400_01672c1b0f4c.slice/crio-0f3b79cbefda3eed62dde8e84f839af5160af6df151a883cc0967c868154e1db WatchSource:0}: Error finding container 0f3b79cbefda3eed62dde8e84f839af5160af6df151a883cc0967c868154e1db: Status 404 returned error can't find the container with id 0f3b79cbefda3eed62dde8e84f839af5160af6df151a883cc0967c868154e1db
Jul 25 02:07:48.318191 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.318156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:07:48.319830 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:07:48.319798    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d37753e_6228_4219_a99f_4b923a1fbb2e.slice/crio-60db3c39ab325708774ad07f9ed1e52e01aa3a1045d7fc6bad3a91efdd275910 WatchSource:0}: Error finding container 60db3c39ab325708774ad07f9ed1e52e01aa3a1045d7fc6bad3a91efdd275910: Status 404 returned error can't find the container with id 60db3c39ab325708774ad07f9ed1e52e01aa3a1045d7fc6bad3a91efdd275910
Jul 25 02:07:48.920455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.920424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" event={"ID":"cd606b8a-cdc9-4668-a400-01672c1b0f4c","Type":"ContainerStarted","Data":"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"}
Jul 25 02:07:48.920688 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.920475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" event={"ID":"cd606b8a-cdc9-4668-a400-01672c1b0f4c","Type":"ContainerStarted","Data":"0f3b79cbefda3eed62dde8e84f839af5160af6df151a883cc0967c868154e1db"}
Jul 25 02:07:48.920688 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.920548    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:48.922264 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.922243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" event={"ID":"4d37753e-6228-4219-a99f-4b923a1fbb2e","Type":"ContainerStarted","Data":"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"}
Jul 25 02:07:48.922447 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.922279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" event={"ID":"4d37753e-6228-4219-a99f-4b923a1fbb2e","Type":"ContainerStarted","Data":"60db3c39ab325708774ad07f9ed1e52e01aa3a1045d7fc6bad3a91efdd275910"}
Jul 25 02:07:48.922447 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.922380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:07:48.936635 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.936592    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" podStartSLOduration=1.936578793 podStartE2EDuration="1.936578793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:07:48.934638995 +0000 UTC m=+3387.837284008" watchObservedRunningTime="2026-07-25 02:07:48.936578793 +0000 UTC m=+3387.839223804"
Jul 25 02:07:48.948159 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:48.948120    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" podStartSLOduration=1.9481064959999999 podStartE2EDuration="1.948106496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:07:48.946762933 +0000 UTC m=+3387.849407972" watchObservedRunningTime="2026-07-25 02:07:48.948106496 +0000 UTC m=+3387.850751508"
Jul 25 02:07:51.316722 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:51.316682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:07:53.897082 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:53.896672    2565 patch_prober.go:28] interesting pod/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 02:07:53.897082 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:53.896739    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 02:07:55.963738 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.963708    2565 generic.go:356] "Generic (PLEG): container finished" podID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerID="d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9" exitCode=0
Jul 25 02:07:55.964177 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.963781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerDied","Data":"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"}
Jul 25 02:07:55.964226 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.964218    2565 scope.go:117] "RemoveContainer" containerID="d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"
Jul 25 02:07:55.965281 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.965253    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:55.965389 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.965333    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:55.965389 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:55.965383    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:07:56.970588 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:56.970547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerStarted","Data":"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"}
Jul 25 02:07:57.138885 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:57.138843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:07:57.139121 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:57.139097    2565 patch_prober.go:28] interesting pod/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 25 02:07:57.139211 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:57.139155    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 25 02:07:58.138348 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:58.138320    2565 patch_prober.go:28] interesting pod/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 25 02:07:58.138814 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:58.138792    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 25 02:07:59.138747 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:59.138709    2565 patch_prober.go:28] interesting pod/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 25 02:07:59.139096 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:59.138775    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 25 02:07:59.930410 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:59.930380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:07:59.930641 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:07:59.930466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:08:00.138895 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:00.138857    2565 patch_prober.go:28] interesting pod/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 25 02:08:00.139297 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:00.138928    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 25 02:08:01.142181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:01.142147    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:08:01.142597 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:01.142552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:08:01.143275 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:01.143249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:08:01.943671 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:01.943637    2565 patch_prober.go:28] interesting pod/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 02:08:01.949428 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:01.943713    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 02:08:03.029932 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.029900    2565 generic.go:356] "Generic (PLEG): container finished" podID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerID="9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78" exitCode=0
Jul 25 02:08:03.030325 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.029968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerDied","Data":"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"}
Jul 25 02:08:03.030472 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.030456    2565 scope.go:117] "RemoveContainer" containerID="9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"
Jul 25 02:08:03.031420 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.031392    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:08:03.031535 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.031455    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:08:03.031535 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:03.031486    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:08:04.037144 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:04.037108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerStarted","Data":"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"}
Jul 25 02:08:04.164479 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:04.164439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:08:04.164683 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:04.164615    2565 patch_prober.go:28] interesting pod/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 25 02:08:04.164683 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:04.164660    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 25 02:08:05.164970 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:05.164934    2565 patch_prober.go:28] interesting pod/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 25 02:08:05.165391 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:05.164990    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 25 02:08:06.164724 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:06.164690    2565 patch_prober.go:28] interesting pod/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 25 02:08:06.164903 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:06.164762    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 25 02:08:07.164565 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:07.164528    2565 patch_prober.go:28] interesting pod/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 25 02:08:07.164978 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:07.164590    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 25 02:08:08.168366 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:08.168335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:08:08.168778 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:08.168602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:08:08.169326 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:08.169309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:08:09.358456 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:09.358423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:08:22.138753 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:22.138669    2565 scope.go:117] "RemoveContainer" containerID="ffdd77c0106f66fad77eff47a6f6af074bc63120c33eaaedaaab201a5ecda7ae"
Jul 25 02:08:28.857880 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:28.857842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:08:56.942989 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:56.942904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:08:58.342964 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:08:58.342919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:10:19.346799 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:10:19.346766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:11:15.779621 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:11:15.779531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:12:19.698078 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:19.698046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:12:22.191958 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:22.191929    2565 scope.go:117] "RemoveContainer" containerID="f2e8108a9d67cc5982041f5b7f3495436e4b1329862a0632755b11542f7bc83c"
Jul 25 02:12:22.201051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:22.201035    2565 scope.go:117] "RemoveContainer" containerID="4f112a1f57fdad3943ba9e416b9c572402aeb8bd53ff172007f55938751378d6"
Jul 25 02:12:46.405214 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:46.405128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:12:47.243868 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:47.243829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:12:53.265440 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:12:53.265395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:13:18.819818 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:13:18.819775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:13:28.711648 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:13:28.711610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:13:50.297982 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:13:50.297943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:14:20.938885 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:14:20.938809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:14:22.915058 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:14:22.915018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:14:39.407224 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:14:39.407188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:15:01.003779 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:01.003748    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:15:01.104095 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:01.104053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:15:03.188260 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:03.188232    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"]
Jul 25 02:15:03.191258 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:03.191234    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29749050-wzwrz"]
Jul 25 02:15:03.645062 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:03.645034    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c8c394-2dc2-4506-9ebc-8076094fe65c" path="/var/lib/kubelet/pods/b1c8c394-2dc2-4506-9ebc-8076094fe65c/volumes"
Jul 25 02:15:06.450266 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:06.450224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:15:22.249801 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:15:22.249772    2565 scope.go:117] "RemoveContainer" containerID="2d6b5717569696a93fb32643891a7cb579841df71b9e79da84ab41a07633cee9"
Jul 25 02:16:20.168141 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:20.168102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:21.051552 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:21.051490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:40.982107 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:40.982075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:41.269147 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.269042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:16:41.271871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.271850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.273835 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.273810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-67eb46-openshift-default-dockercfg-mpt6h\""
Jul 25 02:16:41.283978 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.283944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284133 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.283990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284133 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284133 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284311 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284311 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284311 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284421 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.284462 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.284444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbddd\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.285484 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.285465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:16:41.299076 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.299028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:41.385893 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.385849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.386617 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.386477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.386809 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.386580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.386969 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.386953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387078 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387191 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387308 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387412 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387779 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.387779 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbddd\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.388320 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.387401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.388968 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.388937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.389262 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.389244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.389990 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.389965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.390351 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.390330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.395458 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.395433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.395885 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.395857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbddd\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd\") pod \"e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") " pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.583224 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.583183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:41.708875 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.708847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:41.726534 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.726480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:16:41.728563 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:16:41.728534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb069a2a_6bb1_490e_866e_7323311c7ff4.slice/crio-2858d4058ba0193e96fb500617370ab0a60794327acfb8911927871e0d19686c WatchSource:0}: Error finding container 2858d4058ba0193e96fb500617370ab0a60794327acfb8911927871e0d19686c: Status 404 returned error can't find the container with id 2858d4058ba0193e96fb500617370ab0a60794327acfb8911927871e0d19686c
Jul 25 02:16:41.730818 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.730784    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:16:41.730911 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.730851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:16:41.730911 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.730878    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:16:41.743673 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:41.743644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerStarted","Data":"2858d4058ba0193e96fb500617370ab0a60794327acfb8911927871e0d19686c"}
Jul 25 02:16:42.750764 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:42.750725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerStarted","Data":"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"}
Jul 25 02:16:42.770386 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:42.770340    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podStartSLOduration=1.770323375 podStartE2EDuration="1.770323375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:16:42.766869922 +0000 UTC m=+3921.669514935" watchObservedRunningTime="2026-07-25 02:16:42.770323375 +0000 UTC m=+3921.672968386"
Jul 25 02:16:43.584047 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:43.584011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:43.588769 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:43.588744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:43.758234 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:43.758203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:43.759145 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:43.759127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:16:44.775156 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:44.775115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:44.875936 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:44.875901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:45.102520 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.102484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:45.222613 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.222573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:45.576134 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.576046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:45.671501 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.671467    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:16:45.674047 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.674015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.675380 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.675350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:45.675790 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.675774    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-67eb46\""
Jul 25 02:16:45.675894 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.675885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-67eb46-dockercfg-z4wlg\""
Jul 25 02:16:45.682521 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.682488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:16:45.733181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.733149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm9g5\" (UniqueName: \"kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.733381 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.733222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.834164 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.834127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.834642 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.834415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm9g5\" (UniqueName: \"kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.835146 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.835123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.844053 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.844021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm9g5\" (UniqueName: \"kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5\") pod \"payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:45.987244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:45.987205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:46.126757 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:46.126727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:16:46.128842 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:16:46.128814    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e9c952_7889_496a_8617_766e79956b4f.slice/crio-f867214d5038f4bd3ba1445fb1a9dc6c6cfc07fb754bbaec9e27d8889b15cc3d WatchSource:0}: Error finding container f867214d5038f4bd3ba1445fb1a9dc6c6cfc07fb754bbaec9e27d8889b15cc3d: Status 404 returned error can't find the container with id f867214d5038f4bd3ba1445fb1a9dc6c6cfc07fb754bbaec9e27d8889b15cc3d
Jul 25 02:16:46.776065 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:46.776027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" event={"ID":"33e9c952-7889-496a-8617-766e79956b4f","Type":"ContainerStarted","Data":"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"}
Jul 25 02:16:46.776337 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:46.776093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" event={"ID":"33e9c952-7889-496a-8617-766e79956b4f","Type":"ContainerStarted","Data":"f867214d5038f4bd3ba1445fb1a9dc6c6cfc07fb754bbaec9e27d8889b15cc3d"}
Jul 25 02:16:46.776337 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:46.776136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:46.790966 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:46.790900    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" podStartSLOduration=1.790884921 podStartE2EDuration="1.790884921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:16:46.788857586 +0000 UTC m=+3925.691502601" watchObservedRunningTime="2026-07-25 02:16:46.790884921 +0000 UTC m=+3925.693529933"
Jul 25 02:16:49.221657 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:49.221612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:16:57.784736 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:57.784700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:16:59.799695 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:59.799646    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 02:16:59.800098 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:16:59.799738    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 02:17:00.136226 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:00.136192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:00.460107 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:00.460022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:00.794376 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:00.794291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:01.864669 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.864582    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerID="be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd" exitCode=0
Jul 25 02:17:01.865092 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.864661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerDied","Data":"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"}
Jul 25 02:17:01.865138 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.865092    2565 scope.go:117] "RemoveContainer" containerID="be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"
Jul 25 02:17:01.866189 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.866161    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:17:01.866272 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.866224    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:17:01.866272 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:01.866254    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 02:17:02.871764 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:02.871729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerStarted","Data":"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"}
Jul 25 02:17:03.584678 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:03.584645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:17:03.585076 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:03.585053    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 25 02:17:03.585243 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:03.585221    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 25 02:17:04.584618 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:04.584575    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 25 02:17:04.585155 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:04.584654    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 25 02:17:05.584404 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:05.584363    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 25 02:17:05.584638 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:05.584445    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 25 02:17:06.396196 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:06.396162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:06.496279 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:06.496244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:06.584036 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:06.584000    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 25 02:17:06.584322 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:06.584293    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 25 02:17:07.588065 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:07.588028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:17:07.588558 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:07.588296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:17:07.589048 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:07.589032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:17:07.666492 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:07.666444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:07.918358 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:07.918270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:08.103701 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.103664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:08.205526 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.205413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:08.215064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.215039    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:17:08.218744 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.218726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.220706 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.220685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-dc8abe\""
Jul 25 02:17:08.220823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.220802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-dc8abe-dockercfg-9m7xl\""
Jul 25 02:17:08.233056 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.233033    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:17:08.248709 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.248677    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:17:08.252279 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.252259    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.260325 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.260296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:17:08.296569 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.296537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nb2g\" (UniqueName: \"kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.296736 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.296589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.296736 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.296633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.296736 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.296665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4jxl\" (UniqueName: \"kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.398218 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.398180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nb2g\" (UniqueName: \"kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.398416 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.398234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.398416 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.398270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.398416 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.398300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4jxl\" (UniqueName: \"kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.399072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.399052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.399118 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.399083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.405374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.405352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4jxl\" (UniqueName: \"kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl\") pod \"payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.405434 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.405351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nb2g\" (UniqueName: \"kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g\") pod \"payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.529321 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.529230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.564196 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.564170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:08.687380 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.687350    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:17:08.691168 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:17:08.691128    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359db05b_7af9_467d_8988_8fbe27468b1c.slice/crio-41bbf5a94d2f71adfdaf667a7e7796dd1506c916bbf7330f150bc4159b80c407 WatchSource:0}: Error finding container 41bbf5a94d2f71adfdaf667a7e7796dd1506c916bbf7330f150bc4159b80c407: Status 404 returned error can't find the container with id 41bbf5a94d2f71adfdaf667a7e7796dd1506c916bbf7330f150bc4159b80c407
Jul 25 02:17:08.917292 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.917252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" event={"ID":"359db05b-7af9-467d-8988-8fbe27468b1c","Type":"ContainerStarted","Data":"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"}
Jul 25 02:17:08.917484 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.917319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" event={"ID":"359db05b-7af9-467d-8988-8fbe27468b1c","Type":"ContainerStarted","Data":"41bbf5a94d2f71adfdaf667a7e7796dd1506c916bbf7330f150bc4159b80c407"}
Jul 25 02:17:08.917580 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.917503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:08.924881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.924862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:17:08.927060 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:17:08.927039    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4881fd20_df14_42b9_a025_3793876ad4b6.slice/crio-f78505fbeaf97718ff44ab5bc32d1cc3adb57cbffb10060b4f0e0c9296dd1e09 WatchSource:0}: Error finding container f78505fbeaf97718ff44ab5bc32d1cc3adb57cbffb10060b4f0e0c9296dd1e09: Status 404 returned error can't find the container with id f78505fbeaf97718ff44ab5bc32d1cc3adb57cbffb10060b4f0e0c9296dd1e09
Jul 25 02:17:08.934771 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:08.934734    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" podStartSLOduration=0.934720121 podStartE2EDuration="934.720121ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:17:08.932966084 +0000 UTC m=+3947.835611096" watchObservedRunningTime="2026-07-25 02:17:08.934720121 +0000 UTC m=+3947.837365159"
Jul 25 02:17:09.924681 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:09.924639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" event={"ID":"4881fd20-df14-42b9-a025-3793876ad4b6","Type":"ContainerStarted","Data":"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"}
Jul 25 02:17:09.925077 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:09.924695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" event={"ID":"4881fd20-df14-42b9-a025-3793876ad4b6","Type":"ContainerStarted","Data":"f78505fbeaf97718ff44ab5bc32d1cc3adb57cbffb10060b4f0e0c9296dd1e09"}
Jul 25 02:17:09.925077 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:09.924892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:09.939265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:09.939218    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" podStartSLOduration=1.9392006849999999 podStartE2EDuration="1.939200685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:17:09.93781799 +0000 UTC m=+3948.840463005" watchObservedRunningTime="2026-07-25 02:17:09.939200685 +0000 UTC m=+3948.841845696"
Jul 25 02:17:10.889881 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:10.889844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:17:19.927359 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:19.927282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:17:20.933882 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:20.933847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:17:28.169787 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:28.169747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw_4881fd20-df14-42b9-a025-3793876ad4b6/payload-processing/0.log"
Jul 25 02:17:45.872940 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:17:45.872894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:17.784957 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:17.784923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:17.885459 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:17.885419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:28.572761 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:28.572704    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw_4881fd20-df14-42b9-a025-3793876ad4b6/payload-processing/0.log"
Jul 25 02:18:28.852023 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:28.851988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:29.150126 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:29.150022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:29.370266 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:29.370228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:31.770487 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:31.770450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:31.869843 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:31.869806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:33.376183 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.376151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:33.825979 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.825885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:33.924871 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.924842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:33.960144 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.960111    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:18:33.964847 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.964824    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:33.966696 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.966675    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-389518\""
Jul 25 02:18:33.966696 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.966684    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-389518-dockercfg-w7l9s\""
Jul 25 02:18:33.970711 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:33.970685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:18:34.077720 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.077628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.077899 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.077819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k46m\" (UniqueName: \"kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.179195 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.179153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.179350 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.179284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k46m\" (UniqueName: \"kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.179904 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.179882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.189542 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.189503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k46m\" (UniqueName: \"kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m\") pod \"payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.276423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.276396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:34.411564 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:34.411537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:18:34.414436 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:18:34.414411    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2169b0f_0488_4a6c_8f62_ceae4f7202b0.slice/crio-4322a89d3023e746d693da5a27c229a9a403a2a970378336cd36b6e7897a17dc WatchSource:0}: Error finding container 4322a89d3023e746d693da5a27c229a9a403a2a970378336cd36b6e7897a17dc: Status 404 returned error can't find the container with id 4322a89d3023e746d693da5a27c229a9a403a2a970378336cd36b6e7897a17dc
Jul 25 02:18:35.391455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:35.391418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" event={"ID":"f2169b0f-0488-4a6c-8f62-ceae4f7202b0","Type":"ContainerStarted","Data":"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"}
Jul 25 02:18:35.391797 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:35.391767    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:18:35.391911 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:35.391806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" event={"ID":"f2169b0f-0488-4a6c-8f62-ceae4f7202b0","Type":"ContainerStarted","Data":"4322a89d3023e746d693da5a27c229a9a403a2a970378336cd36b6e7897a17dc"}
Jul 25 02:18:35.406802 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:35.406752    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" podStartSLOduration=2.406736353 podStartE2EDuration="2.406736353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:18:35.404747751 +0000 UTC m=+4034.307392761" watchObservedRunningTime="2026-07-25 02:18:35.406736353 +0000 UTC m=+4034.309381363"
Jul 25 02:18:36.278284 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:36.278249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:18:47.405333 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:18:47.405252    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:19:03.907257 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:03.907219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:03.929387 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:03.929352    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:19:03.929691 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:03.929659    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" podUID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" containerName="payload-processing" containerID="cri-o://7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23" gracePeriod=30
Jul 25 02:19:04.007770 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.007730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:04.109929 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.109870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:04.226384 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.226359    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:19:04.303200 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.303168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k46m\" (UniqueName: \"kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m\") pod \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") "
Jul 25 02:19:04.303394 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.303332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume\") pod \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\" (UID: \"f2169b0f-0488-4a6c-8f62-ceae4f7202b0\") "
Jul 25 02:19:04.303708 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.303687    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2169b0f-0488-4a6c-8f62-ceae4f7202b0" (UID: "f2169b0f-0488-4a6c-8f62-ceae4f7202b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:19:04.303784 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.303761    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:19:04.305210 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.305190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m" (OuterVolumeSpecName: "kube-api-access-9k46m") pod "f2169b0f-0488-4a6c-8f62-ceae4f7202b0" (UID: "f2169b0f-0488-4a6c-8f62-ceae4f7202b0"). InnerVolumeSpecName "kube-api-access-9k46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:19:04.405064 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.405030    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k46m\" (UniqueName: \"kubernetes.io/projected/f2169b0f-0488-4a6c-8f62-ceae4f7202b0-kube-api-access-9k46m\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:19:04.555825 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.555741    2565 generic.go:356] "Generic (PLEG): container finished" podID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" containerID="7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23" exitCode=0
Jul 25 02:19:04.555825 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.555787    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"
Jul 25 02:19:04.556033 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.555830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" event={"ID":"f2169b0f-0488-4a6c-8f62-ceae4f7202b0","Type":"ContainerDied","Data":"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"}
Jul 25 02:19:04.556033 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.555911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2" event={"ID":"f2169b0f-0488-4a6c-8f62-ceae4f7202b0","Type":"ContainerDied","Data":"4322a89d3023e746d693da5a27c229a9a403a2a970378336cd36b6e7897a17dc"}
Jul 25 02:19:04.556033 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.555938    2565 scope.go:117] "RemoveContainer" containerID="7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"
Jul 25 02:19:04.565646 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.565624    2565 scope.go:117] "RemoveContainer" containerID="7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"
Jul 25 02:19:04.565905 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:19:04.565886    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23\": container with ID starting with 7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23 not found: ID does not exist" containerID="7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"
Jul 25 02:19:04.565963 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.565914    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23"} err="failed to get container status \"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23\": rpc error: code = NotFound desc = could not find container \"7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23\": container with ID starting with 7f1f9b34a1d746e1e539a64d5c2b6a50e3671b61eff9062efc8c6449dcbdea23 not found: ID does not exist"
Jul 25 02:19:04.576080 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.576050    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:19:04.579542 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:04.579520    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-389518-7c4799df56-87dn2"]
Jul 25 02:19:05.645659 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:05.645629    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" path="/var/lib/kubelet/pods/f2169b0f-0488-4a6c-8f62-ceae4f7202b0/volumes"
Jul 25 02:19:07.550192 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:07.550159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:07.948340 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:07.948304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:13.841890 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:13.841857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:13.903474 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:13.903436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:14.101043 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:14.100948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:14.313181 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:14.313143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:35.382761 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.382729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:35.415188 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.415155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:19:35.415410 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.415383    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" podUID="33e9c952-7889-496a-8617-766e79956b4f" containerName="payload-pre-processing" containerID="cri-o://a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63" gracePeriod=30
Jul 25 02:19:35.688955 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.688911    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:19:35.728641 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.728614    2565 generic.go:356] "Generic (PLEG): container finished" podID="33e9c952-7889-496a-8617-766e79956b4f" containerID="a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63" exitCode=0
Jul 25 02:19:35.728836 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.728686    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"
Jul 25 02:19:35.728836 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.728701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" event={"ID":"33e9c952-7889-496a-8617-766e79956b4f","Type":"ContainerDied","Data":"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"}
Jul 25 02:19:35.728836 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.728754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv" event={"ID":"33e9c952-7889-496a-8617-766e79956b4f","Type":"ContainerDied","Data":"f867214d5038f4bd3ba1445fb1a9dc6c6cfc07fb754bbaec9e27d8889b15cc3d"}
Jul 25 02:19:35.728836 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.728781    2565 scope.go:117] "RemoveContainer" containerID="a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"
Jul 25 02:19:35.738216 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.738193    2565 scope.go:117] "RemoveContainer" containerID="a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"
Jul 25 02:19:35.738469 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:19:35.738450    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63\": container with ID starting with a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63 not found: ID does not exist" containerID="a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"
Jul 25 02:19:35.738574 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.738477    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63"} err="failed to get container status \"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63\": rpc error: code = NotFound desc = could not find container \"a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63\": container with ID starting with a6664371b6d70e9e1ab8bd77815e1d73209f52d52cfee48842428b74f8f67b63 not found: ID does not exist"
Jul 25 02:19:35.839628 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.839593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm9g5\" (UniqueName: \"kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5\") pod \"33e9c952-7889-496a-8617-766e79956b4f\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") "
Jul 25 02:19:35.839802 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.839731    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume\") pod \"33e9c952-7889-496a-8617-766e79956b4f\" (UID: \"33e9c952-7889-496a-8617-766e79956b4f\") "
Jul 25 02:19:35.840132 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.840106    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33e9c952-7889-496a-8617-766e79956b4f" (UID: "33e9c952-7889-496a-8617-766e79956b4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:19:35.841659 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.841628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5" (OuterVolumeSpecName: "kube-api-access-hm9g5") pod "33e9c952-7889-496a-8617-766e79956b4f" (UID: "33e9c952-7889-496a-8617-766e79956b4f"). InnerVolumeSpecName "kube-api-access-hm9g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:19:35.941227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.941140    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm9g5\" (UniqueName: \"kubernetes.io/projected/33e9c952-7889-496a-8617-766e79956b4f-kube-api-access-hm9g5\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:19:35.941227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:35.941169    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33e9c952-7889-496a-8617-766e79956b4f-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:19:36.048997 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:36.048969    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:19:36.051151 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:36.051128    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-67eb46-876475484-kqvxv"]
Jul 25 02:19:36.476120 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:36.476090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:37.645490 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:37.645460    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e9c952-7889-496a-8617-766e79956b4f" path="/var/lib/kubelet/pods/33e9c952-7889-496a-8617-766e79956b4f/volumes"
Jul 25 02:19:37.793069 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:37.793033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:38.186829 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:38.186801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:19:43.266296 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:19:43.266250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:19.307651 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:19.307569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:20.791018 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:20.790987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:21.644092 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:21.644060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:26.596661 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:26.596624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:50.329092 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.329057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:50.418975 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.418935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:50.589558 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.589501    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:20:50.589824 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.589794    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" containerID="cri-o://c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e" gracePeriod=30
Jul 25 02:20:50.612567 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.612534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:50.853193 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:50.853107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:20:52.590921 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:52.590881    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 02:20:52.591415 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:52.590948    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 02:20:55.856699 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.856633    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:20:55.958034 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.957999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbddd\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958227 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958604 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958604 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy\") pod \"bb069a2a-6bb1-490e-866e-7323311c7ff4\" (UID: \"bb069a2a-6bb1-490e-866e-7323311c7ff4\") "
Jul 25 02:20:55.958604 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958455    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:20:55.958604 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958474    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:20:55.958823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:20:55.958823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958740    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:55.958823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958763    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:55.958823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958776    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:55.959006 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.958842    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:20:55.959574 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.959546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:20:55.960345 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.960325    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd" (OuterVolumeSpecName: "kube-api-access-vbddd") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "kube-api-access-vbddd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:20:55.960442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.960379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:20:55.960755 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.960736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:20:55.960827 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:55.960810    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb069a2a-6bb1-490e-866e-7323311c7ff4" (UID: "bb069a2a-6bb1-490e-866e-7323311c7ff4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:20:56.059989 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.059956    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.059989 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.059983    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.059989 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.059991    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.059989 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.059999    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb069a2a-6bb1-490e-866e-7323311c7ff4-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.060244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.060006    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb069a2a-6bb1-490e-866e-7323311c7ff4-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.060244 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.060014    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbddd\" (UniqueName: \"kubernetes.io/projected/bb069a2a-6bb1-490e-866e-7323311c7ff4-kube-api-access-vbddd\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:20:56.169772 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.169679    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerID="c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e" exitCode=0
Jul 25 02:20:56.169772 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.169744    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"
Jul 25 02:20:56.169973 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.169769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerDied","Data":"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"}
Jul 25 02:20:56.169973 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.169832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48" event={"ID":"bb069a2a-6bb1-490e-866e-7323311c7ff4","Type":"ContainerDied","Data":"2858d4058ba0193e96fb500617370ab0a60794327acfb8911927871e0d19686c"}
Jul 25 02:20:56.169973 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.169855    2565 scope.go:117] "RemoveContainer" containerID="c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"
Jul 25 02:20:56.182206 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.182183    2565 scope.go:117] "RemoveContainer" containerID="be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"
Jul 25 02:20:56.196169 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.196113    2565 scope.go:117] "RemoveContainer" containerID="c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"
Jul 25 02:20:56.196268 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.196160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:20:56.196655 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:20:56.196610    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e\": container with ID starting with c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e not found: ID does not exist" containerID="c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"
Jul 25 02:20:56.196776 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.196682    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e"} err="failed to get container status \"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e\": rpc error: code = NotFound desc = could not find container \"c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e\": container with ID starting with c3a5eeba1fdfd49860cea4c5c05096eebe41db5358fca87ae09b7d21ba22c43e not found: ID does not exist"
Jul 25 02:20:56.196776 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.196725    2565 scope.go:117] "RemoveContainer" containerID="be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"
Jul 25 02:20:56.197117 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:20:56.197096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd\": container with ID starting with be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd not found: ID does not exist" containerID="be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"
Jul 25 02:20:56.197190 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.197123    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd"} err="failed to get container status \"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd\": rpc error: code = NotFound desc = could not find container \"be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd\": container with ID starting with be241b3aa12ebc28fa6940ad6c1e4d381fa41b98c3336400157cdf511e1229bd not found: ID does not exist"
Jul 25 02:20:56.198763 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:56.198743    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-67eb46-openshift-default-bbcf476b-ckf48"]
Jul 25 02:20:57.647213 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:20:57.647168    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" path="/var/lib/kubelet/pods/bb069a2a-6bb1-490e-866e-7323311c7ff4/volumes"
Jul 25 02:21:01.492108 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.492073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:01.510272 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.510241    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:21:01.510479 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.510447    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" podUID="4881fd20-df14-42b9-a025-3793876ad4b6" containerName="payload-processing" containerID="cri-o://f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab" gracePeriod=30
Jul 25 02:21:01.516020 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.515721    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:21:01.516020 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.515924    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" podUID="359db05b-7af9-467d-8988-8fbe27468b1c" containerName="payload-pre-processing" containerID="cri-o://31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d" gracePeriod=30
Jul 25 02:21:01.552536 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.552336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:01.653072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.653020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:01.786038 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.786016    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:21:01.817035 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.817014    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:21:01.819144 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.819123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume\") pod \"4881fd20-df14-42b9-a025-3793876ad4b6\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") "
Jul 25 02:21:01.819265 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.819205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4jxl\" (UniqueName: \"kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl\") pod \"4881fd20-df14-42b9-a025-3793876ad4b6\" (UID: \"4881fd20-df14-42b9-a025-3793876ad4b6\") "
Jul 25 02:21:01.819495 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.819472    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4881fd20-df14-42b9-a025-3793876ad4b6" (UID: "4881fd20-df14-42b9-a025-3793876ad4b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:21:01.821438 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.821420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl" (OuterVolumeSpecName: "kube-api-access-l4jxl") pod "4881fd20-df14-42b9-a025-3793876ad4b6" (UID: "4881fd20-df14-42b9-a025-3793876ad4b6"). InnerVolumeSpecName "kube-api-access-l4jxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:01.920476 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.920448    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nb2g\" (UniqueName: \"kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g\") pod \"359db05b-7af9-467d-8988-8fbe27468b1c\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") "
Jul 25 02:21:01.920672 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.920590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume\") pod \"359db05b-7af9-467d-8988-8fbe27468b1c\" (UID: \"359db05b-7af9-467d-8988-8fbe27468b1c\") "
Jul 25 02:21:01.920867 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.920841    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4881fd20-df14-42b9-a025-3793876ad4b6-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:01.920867 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.920858    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4jxl\" (UniqueName: \"kubernetes.io/projected/4881fd20-df14-42b9-a025-3793876ad4b6-kube-api-access-l4jxl\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:01.921042 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.920945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "359db05b-7af9-467d-8988-8fbe27468b1c" (UID: "359db05b-7af9-467d-8988-8fbe27468b1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:21:01.922455 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:01.922437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g" (OuterVolumeSpecName: "kube-api-access-4nb2g") pod "359db05b-7af9-467d-8988-8fbe27468b1c" (UID: "359db05b-7af9-467d-8988-8fbe27468b1c"). InnerVolumeSpecName "kube-api-access-4nb2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:02.021564 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.021473    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/359db05b-7af9-467d-8988-8fbe27468b1c-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:02.021564 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.021496    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nb2g\" (UniqueName: \"kubernetes.io/projected/359db05b-7af9-467d-8988-8fbe27468b1c-kube-api-access-4nb2g\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:02.115909 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.115882    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:02.201850 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.201821    2565 generic.go:356] "Generic (PLEG): container finished" podID="359db05b-7af9-467d-8988-8fbe27468b1c" containerID="31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d" exitCode=0
Jul 25 02:21:02.202017 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.201869    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"
Jul 25 02:21:02.202017 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.201923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" event={"ID":"359db05b-7af9-467d-8988-8fbe27468b1c","Type":"ContainerDied","Data":"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"}
Jul 25 02:21:02.202017 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.201979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j" event={"ID":"359db05b-7af9-467d-8988-8fbe27468b1c","Type":"ContainerDied","Data":"41bbf5a94d2f71adfdaf667a7e7796dd1506c916bbf7330f150bc4159b80c407"}
Jul 25 02:21:02.202017 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.202013    2565 scope.go:117] "RemoveContainer" containerID="31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"
Jul 25 02:21:02.203383 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.203360    2565 generic.go:356] "Generic (PLEG): container finished" podID="4881fd20-df14-42b9-a025-3793876ad4b6" containerID="f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab" exitCode=0
Jul 25 02:21:02.203529 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.203393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" event={"ID":"4881fd20-df14-42b9-a025-3793876ad4b6","Type":"ContainerDied","Data":"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"}
Jul 25 02:21:02.203529 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.203414    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"
Jul 25 02:21:02.203529 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.203437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw" event={"ID":"4881fd20-df14-42b9-a025-3793876ad4b6","Type":"ContainerDied","Data":"f78505fbeaf97718ff44ab5bc32d1cc3adb57cbffb10060b4f0e0c9296dd1e09"}
Jul 25 02:21:02.213831 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.213811    2565 scope.go:117] "RemoveContainer" containerID="31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"
Jul 25 02:21:02.214365 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:02.214333    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d\": container with ID starting with 31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d not found: ID does not exist" containerID="31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"
Jul 25 02:21:02.214469 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.214377    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d"} err="failed to get container status \"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d\": rpc error: code = NotFound desc = could not find container \"31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d\": container with ID starting with 31d9e66af54b4cad19adc3b70d29f88262909938749a3114558687db7dee4a7d not found: ID does not exist"
Jul 25 02:21:02.214469 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.214402    2565 scope.go:117] "RemoveContainer" containerID="f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"
Jul 25 02:21:02.221357 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.221330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:02.224971 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.224956    2565 scope.go:117] "RemoveContainer" containerID="f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"
Jul 25 02:21:02.225219 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:02.225198    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab\": container with ID starting with f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab not found: ID does not exist" containerID="f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"
Jul 25 02:21:02.225294 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.225225    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab"} err="failed to get container status \"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab\": rpc error: code = NotFound desc = could not find container \"f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab\": container with ID starting with f1b469680a09561dc6976274f0b5543fe28c504ddf85aa98780df783a4c0e6ab not found: ID does not exist"
Jul 25 02:21:02.230220 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.230200    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:21:02.233013 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.232993    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-dc8abe-5b7cd784b4-nx85j"]
Jul 25 02:21:02.241750 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.241731    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:21:02.245007 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:02.244987    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-dc8abe-578b6dc57d-9flmw"]
Jul 25 02:21:03.645687 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:03.645657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359db05b-7af9-467d-8988-8fbe27468b1c" path="/var/lib/kubelet/pods/359db05b-7af9-467d-8988-8fbe27468b1c/volumes"
Jul 25 02:21:03.646096 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:03.646001    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4881fd20-df14-42b9-a025-3793876ad4b6" path="/var/lib/kubelet/pods/4881fd20-df14-42b9-a025-3793876ad4b6/volumes"
Jul 25 02:21:06.053040 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:06.052997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:06.451051 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:06.451009    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:12.644926 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:12.644886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:12.745930 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:12.745895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:12.909368 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:12.909277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:13.136628 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:13.136581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:23.435861 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:23.435824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:23.500399 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:23.500359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:23.551025 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:23.550991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:28.348775 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:28.348728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:28.740092 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:28.740003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:34.691335 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:34.691294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:34.751855 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:34.751815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:34.927753 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:34.927716    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:21:34.927967 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:34.927946    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy" containerID="cri-o://347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1" gracePeriod=30
Jul 25 02:21:34.947934 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:34.947843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:35.170828 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:35.170795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:40.189277 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.189218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:21:40.312486 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312486 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312591    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312634    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnfw9\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312702    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.312739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.313002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.313002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312750    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:21:40.313002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy\") pod \"a083b4ac-09b0-4d78-a528-0f04459ed49d\" (UID: \"a083b4ac-09b0-4d78-a528-0f04459ed49d\") "
Jul 25 02:21:40.313002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:21:40.313002 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.312994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:21:40.313269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.313172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:21:40.313269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.313189    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.313269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.313206    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.313269 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.313218    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.313433 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.313324    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:21:40.315072 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.315024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:21:40.315198 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.315145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9" (OuterVolumeSpecName: "kube-api-access-mnfw9") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "kube-api-access-mnfw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:40.315370 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.315345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:21:40.315370 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.315346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a083b4ac-09b0-4d78-a528-0f04459ed49d" (UID: "a083b4ac-09b0-4d78-a528-0f04459ed49d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:40.412747 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.412712    2565 generic.go:356] "Generic (PLEG): container finished" podID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerID="347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1" exitCode=0
Jul 25 02:21:40.412941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.412760    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"
Jul 25 02:21:40.412941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.412801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerDied","Data":"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"}
Jul 25 02:21:40.412941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.412870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l" event={"ID":"a083b4ac-09b0-4d78-a528-0f04459ed49d","Type":"ContainerDied","Data":"62614345cdec70ec605f7ef3d04978624b2db4090c23e1106093fa88972563e1"}
Jul 25 02:21:40.412941 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.412897    2565 scope.go:117] "RemoveContainer" containerID="347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413850    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413871    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnfw9\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-kube-api-access-mnfw9\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413887    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413901    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a083b4ac-09b0-4d78-a528-0f04459ed49d-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413913    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.413977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.413926    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a083b4ac-09b0-4d78-a528-0f04459ed49d-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:40.422498 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.422484    2565 scope.go:117] "RemoveContainer" containerID="d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"
Jul 25 02:21:40.430980 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.430964    2565 scope.go:117] "RemoveContainer" containerID="347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"
Jul 25 02:21:40.431395 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:40.431368    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1\": container with ID starting with 347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1 not found: ID does not exist" containerID="347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"
Jul 25 02:21:40.431486 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.431407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1"} err="failed to get container status \"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1\": rpc error: code = NotFound desc = could not find container \"347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1\": container with ID starting with 347aa688efa545557168a3b089db646cee256cdc58c76313562964c0ccf232e1 not found: ID does not exist"
Jul 25 02:21:40.431486 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.431430    2565 scope.go:117] "RemoveContainer" containerID="d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"
Jul 25 02:21:40.431735 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:40.431717    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9\": container with ID starting with d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9 not found: ID does not exist" containerID="d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"
Jul 25 02:21:40.431793 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.431745    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9"} err="failed to get container status \"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9\": rpc error: code = NotFound desc = could not find container \"d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9\": container with ID starting with d9ac4e5e894cac941a338054dd37a1221f358281726f34ec8f255babf340daa9 not found: ID does not exist"
Jul 25 02:21:40.432746 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.432728    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:21:40.436356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:40.436337    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7e06ec-openshift-default-64845bc7fb-7hp6l"]
Jul 25 02:21:41.646847 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:41.646815    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" path="/var/lib/kubelet/pods/a083b4ac-09b0-4d78-a528-0f04459ed49d/volumes"
Jul 25 02:21:45.927144 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.927060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:45.948165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.948131    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:21:45.948421 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.948373    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" podUID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" containerName="payload-processing" containerID="cri-o://d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84" gracePeriod=30
Jul 25 02:21:45.955768 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.955740    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:21:45.956006 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.955971    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" podUID="4d37753e-6228-4219-a99f-4b923a1fbb2e" containerName="payload-pre-processing" containerID="cri-o://22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06" gracePeriod=30
Jul 25 02:21:45.995243 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:45.995206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:46.050921 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.050889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:46.215522 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.215485    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:21:46.249793 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.249768    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:21:46.270801 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.270774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbgnm\" (UniqueName: \"kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm\") pod \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") "
Jul 25 02:21:46.270978 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.270855    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume\") pod \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\" (UID: \"cd606b8a-cdc9-4668-a400-01672c1b0f4c\") "
Jul 25 02:21:46.271213 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.271192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd606b8a-cdc9-4668-a400-01672c1b0f4c" (UID: "cd606b8a-cdc9-4668-a400-01672c1b0f4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:21:46.272926 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.272897    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm" (OuterVolumeSpecName: "kube-api-access-kbgnm") pod "cd606b8a-cdc9-4668-a400-01672c1b0f4c" (UID: "cd606b8a-cdc9-4668-a400-01672c1b0f4c"). InnerVolumeSpecName "kube-api-access-kbgnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:46.371896 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.371858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgj52\" (UniqueName: \"kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52\") pod \"4d37753e-6228-4219-a99f-4b923a1fbb2e\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") "
Jul 25 02:21:46.372093 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.371994    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume\") pod \"4d37753e-6228-4219-a99f-4b923a1fbb2e\" (UID: \"4d37753e-6228-4219-a99f-4b923a1fbb2e\") "
Jul 25 02:21:46.372298 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.372282    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbgnm\" (UniqueName: \"kubernetes.io/projected/cd606b8a-cdc9-4668-a400-01672c1b0f4c-kube-api-access-kbgnm\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:46.372356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.372303    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd606b8a-cdc9-4668-a400-01672c1b0f4c-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:46.372356 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.372317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d37753e-6228-4219-a99f-4b923a1fbb2e" (UID: "4d37753e-6228-4219-a99f-4b923a1fbb2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:21:46.373979 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.373958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52" (OuterVolumeSpecName: "kube-api-access-mgj52") pod "4d37753e-6228-4219-a99f-4b923a1fbb2e" (UID: "4d37753e-6228-4219-a99f-4b923a1fbb2e"). InnerVolumeSpecName "kube-api-access-mgj52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:21:46.446900 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.446813    2565 generic.go:356] "Generic (PLEG): container finished" podID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" containerID="d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84" exitCode=0
Jul 25 02:21:46.446900 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.446853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"
Jul 25 02:21:46.447129 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.446903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" event={"ID":"cd606b8a-cdc9-4668-a400-01672c1b0f4c","Type":"ContainerDied","Data":"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"}
Jul 25 02:21:46.447129 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.446964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr" event={"ID":"cd606b8a-cdc9-4668-a400-01672c1b0f4c","Type":"ContainerDied","Data":"0f3b79cbefda3eed62dde8e84f839af5160af6df151a883cc0967c868154e1db"}
Jul 25 02:21:46.447129 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.446985    2565 scope.go:117] "RemoveContainer" containerID="d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"
Jul 25 02:21:46.448423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.448401    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d37753e-6228-4219-a99f-4b923a1fbb2e" containerID="22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06" exitCode=0
Jul 25 02:21:46.448556 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.448443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"
Jul 25 02:21:46.448556 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.448464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" event={"ID":"4d37753e-6228-4219-a99f-4b923a1fbb2e","Type":"ContainerDied","Data":"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"}
Jul 25 02:21:46.448556 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.448548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll" event={"ID":"4d37753e-6228-4219-a99f-4b923a1fbb2e","Type":"ContainerDied","Data":"60db3c39ab325708774ad07f9ed1e52e01aa3a1045d7fc6bad3a91efdd275910"}
Jul 25 02:21:46.457541 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.457524    2565 scope.go:117] "RemoveContainer" containerID="d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"
Jul 25 02:21:46.457884 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:46.457859    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84\": container with ID starting with d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84 not found: ID does not exist" containerID="d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"
Jul 25 02:21:46.458015 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.457891    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84"} err="failed to get container status \"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84\": rpc error: code = NotFound desc = could not find container \"d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84\": container with ID starting with d9009decec69611f061515cd41aa4d8ab07b983c47c424124355cf101563ca84 not found: ID does not exist"
Jul 25 02:21:46.458015 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.457912    2565 scope.go:117] "RemoveContainer" containerID="22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"
Jul 25 02:21:46.466225 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.466199    2565 scope.go:117] "RemoveContainer" containerID="22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"
Jul 25 02:21:46.466460 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:21:46.466441    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06\": container with ID starting with 22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06 not found: ID does not exist" containerID="22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"
Jul 25 02:21:46.466561 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.466467    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06"} err="failed to get container status \"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06\": rpc error: code = NotFound desc = could not find container \"22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06\": container with ID starting with 22362932b6c5a11b89b0729d7f765664664ac18a05ee9d128ed0df7658227c06 not found: ID does not exist"
Jul 25 02:21:46.467888 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.467868    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:21:46.472833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.472812    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgj52\" (UniqueName: \"kubernetes.io/projected/4d37753e-6228-4219-a99f-4b923a1fbb2e-kube-api-access-mgj52\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:46.472833 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.472834    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d37753e-6228-4219-a99f-4b923a1fbb2e-plugins-config-volume\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:21:46.473547 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.473524    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-575aa7-7b5f76966b-tcfhr"]
Jul 25 02:21:46.481235 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.481205    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:21:46.483331 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:46.483313    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-575aa7-855dc5f448-wqjll"]
Jul 25 02:21:47.645907 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:47.645876    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d37753e-6228-4219-a99f-4b923a1fbb2e" path="/var/lib/kubelet/pods/4d37753e-6228-4219-a99f-4b923a1fbb2e/volumes"
Jul 25 02:21:47.646298 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:47.646259    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" path="/var/lib/kubelet/pods/cd606b8a-cdc9-4668-a400-01672c1b0f4c/volumes"
Jul 25 02:21:50.357851 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:50.357810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:50.750769 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:50.750669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:56.526433 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:56.526395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:56.589634 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:56.589570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:56.810284 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:56.810199    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:21:56.810466 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:56.810439    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy" containerID="cri-o://39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3" gracePeriod=30
Jul 25 02:21:56.843220 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:56.843106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:21:57.033122 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:21:57.033085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:22:02.068380 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.068355    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:22:02.128987 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.128955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129036    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129066    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129165 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129180    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l82cf\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:22:02.129442 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data\") pod \"c46c358b-1374-497e-a655-0b9a1a0c208a\" (UID: \"c46c358b-1374-497e-a655-0b9a1a0c208a\") "
Jul 25 02:22:02.129678 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:22:02.129678 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129478    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:22:02.129678 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129578    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 02:22:02.129823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129741    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.129823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129764    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-workload-certs\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.129823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129778    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-credential-socket\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.129823 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.129793    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46c358b-1374-497e-a655-0b9a1a0c208a-istiod-ca-cert\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.130327 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.130303    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:22:02.131416 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.131387    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 02:22:02.131570 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.131447    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf" (OuterVolumeSpecName: "kube-api-access-l82cf") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "kube-api-access-l82cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:22:02.131690 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.131660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 02:22:02.131767 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.131700    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c46c358b-1374-497e-a655-0b9a1a0c208a" (UID: "c46c358b-1374-497e-a655-0b9a1a0c208a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 02:22:02.231172 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.231141    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-data\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.231172 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.231166    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-token\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.231172 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.231174    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-envoy\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.231172 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.231182    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46c358b-1374-497e-a655-0b9a1a0c208a-istio-podinfo\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.231437 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.231191    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l82cf\" (UniqueName: \"kubernetes.io/projected/c46c358b-1374-497e-a655-0b9a1a0c208a-kube-api-access-l82cf\") on node \"ip-10-0-130-23.ec2.internal\" DevicePath \"\""
Jul 25 02:22:02.540293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.540209    2565 generic.go:356] "Generic (PLEG): container finished" podID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerID="39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3" exitCode=0
Jul 25 02:22:02.540293 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.540257    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"
Jul 25 02:22:02.540471 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.540294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerDied","Data":"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"}
Jul 25 02:22:02.540471 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.540358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg" event={"ID":"c46c358b-1374-497e-a655-0b9a1a0c208a","Type":"ContainerDied","Data":"0645f64313c6b3eea03a0e31193020b68dd8c8f00307088d0119d9dd5cdec5da"}
Jul 25 02:22:02.540471 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.540387    2565 scope.go:117] "RemoveContainer" containerID="39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"
Jul 25 02:22:02.549751 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.549734    2565 scope.go:117] "RemoveContainer" containerID="9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"
Jul 25 02:22:02.557598 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.557521    2565 scope.go:117] "RemoveContainer" containerID="39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"
Jul 25 02:22:02.557775 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:22:02.557756    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3\": container with ID starting with 39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3 not found: ID does not exist" containerID="39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"
Jul 25 02:22:02.557832 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.557784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3"} err="failed to get container status \"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3\": rpc error: code = NotFound desc = could not find container \"39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3\": container with ID starting with 39686f346a9efbe02b7353f864c1cf247bea851bd0709c69f43099386f57d7c3 not found: ID does not exist"
Jul 25 02:22:02.557832 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.557802    2565 scope.go:117] "RemoveContainer" containerID="9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"
Jul 25 02:22:02.558036 ip-10-0-130-23 kubenswrapper[2565]: E0725 02:22:02.558022    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78\": container with ID starting with 9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78 not found: ID does not exist" containerID="9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"
Jul 25 02:22:02.558077 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.558041    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78"} err="failed to get container status \"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78\": rpc error: code = NotFound desc = could not find container \"9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78\": container with ID starting with 9763d1e3597ce0eeba80f0c25fb396c805ae505ab49470e590ce0dec2911de78 not found: ID does not exist"
Jul 25 02:22:02.561316 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.561293    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:22:02.567957 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:02.567936    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-575aa7-openshift-default-54f997666d-p4llg"]
Jul 25 02:22:03.075444 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:03.075417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cd5dc4b6d-wt6vf_76b4860d-8947-42bb-8492-b48e149c8179/manager/0.log"
Jul 25 02:22:03.645787 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:03.645753    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" path="/var/lib/kubelet/pods/c46c358b-1374-497e-a655-0b9a1a0c208a/volumes"
Jul 25 02:22:03.668745 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:03.668719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9844cf678-qvbnc_8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb/copy-manifests/0.log"
Jul 25 02:22:03.675012 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:03.674982    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9844cf678-qvbnc_8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb/manager/0.log"
Jul 25 02:22:04.140929 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:04.140905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29749065-qn8nv_3f034755-1844-47e3-b117-89fad8619ef5/cleanup/0.log"
Jul 25 02:22:04.248134 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:04.248107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29749080-tm2kf_0709ebfa-74d9-4d4b-8f7c-66d9ee8879c3/cleanup/0.log"
Jul 25 02:22:06.920010 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:06.919972    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv_e11fcafe-d3c9-4c60-8a23-74bb6eb23a29/istio-proxy/0.log"
Jul 25 02:22:07.039362 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:07.039328    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mc62z_6968c23f-97df-43b0-a9c2-1953b2bd9461/discovery/0.log"
Jul 25 02:22:07.389993 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:07.389962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/1.log"
Jul 25 02:22:07.513192 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:07.513158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-79szl_61ee4fde-e70b-4448-85c3-0492b6c382cb/payload-pre-processing/0.log"
Jul 25 02:22:08.202753 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:08.202724    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cvqvg_7b8e3af0-1e94-47af-b518-526cd0306538/main/0.log"
Jul 25 02:22:08.322330 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:08.322278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zbnnx_ef685094-9a59-4a22-be88-2fd33ebed448/main/0.log"
Jul 25 02:22:14.798718 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:14.798688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:22:14.920543 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:14.920501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log" limit=1024
Jul 25 02:22:17.468374 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:17.468307    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lgctr_84d442b8-e39e-4173-a424-36af1e358299/global-pull-secret-syncer/0.log"
Jul 25 02:22:17.527300 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:17.527272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4tltl_30f3f8c6-fd93-4d5f-961a-f840ed529a6d/konnectivity-agent/0.log"
Jul 25 02:22:17.630926 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:17.630901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-23.ec2.internal_79f46803104cb5b369c0e7545cf31f48/haproxy/0.log"
Jul 25 02:22:24.093573 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.093543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/alertmanager/0.log"
Jul 25 02:22:24.118211 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.118071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/config-reloader/0.log"
Jul 25 02:22:24.141496 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.141463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/kube-rbac-proxy-web/0.log"
Jul 25 02:22:24.162456 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.162411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/kube-rbac-proxy/0.log"
Jul 25 02:22:24.180905 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.180873    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/kube-rbac-proxy-metric/0.log"
Jul 25 02:22:24.202119 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.202088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/prom-label-proxy/0.log"
Jul 25 02:22:24.227308 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.227280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b29ca699-5c38-42f3-bffd-709a001f0187/init-config-reloader/0.log"
Jul 25 02:22:24.305006 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.304973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5fd92_505debb5-370d-42dc-aeda-2a2ad0ba4a74/kube-state-metrics/0.log"
Jul 25 02:22:24.319573 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.319545    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5fd92_505debb5-370d-42dc-aeda-2a2ad0ba4a74/kube-rbac-proxy-main/0.log"
Jul 25 02:22:24.338425 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.338399    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5fd92_505debb5-370d-42dc-aeda-2a2ad0ba4a74/kube-rbac-proxy-self/0.log"
Jul 25 02:22:24.367627 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.367551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bf7bbb96c-kdqs7_418a6175-7129-4194-ac5d-c7062183a235/metrics-server/0.log"
Jul 25 02:22:24.394576 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.394549    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-dfmh6_786b5a2a-839f-49bd-898a-8c7c6c768ae4/monitoring-plugin/0.log"
Jul 25 02:22:24.431739 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.431713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vwx2_7e9fb851-fd76-4d93-b7bc-791aa8bf4673/node-exporter/0.log"
Jul 25 02:22:24.450720 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.450690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vwx2_7e9fb851-fd76-4d93-b7bc-791aa8bf4673/kube-rbac-proxy/0.log"
Jul 25 02:22:24.470364 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.470346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vwx2_7e9fb851-fd76-4d93-b7bc-791aa8bf4673/init-textfile/0.log"
Jul 25 02:22:24.692462 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.692384    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mh8bq_d82fc6be-efaf-459f-9014-00745b51e6a6/kube-rbac-proxy-main/0.log"
Jul 25 02:22:24.735990 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.735936    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mh8bq_d82fc6be-efaf-459f-9014-00745b51e6a6/kube-rbac-proxy-self/0.log"
Jul 25 02:22:24.758423 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.758393    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mh8bq_d82fc6be-efaf-459f-9014-00745b51e6a6/openshift-state-metrics/0.log"
Jul 25 02:22:24.806751 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.806719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/prometheus/0.log"
Jul 25 02:22:24.842224 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.842193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/config-reloader/0.log"
Jul 25 02:22:24.864092 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.864067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/thanos-sidecar/0.log"
Jul 25 02:22:24.883863 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.883840    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/kube-rbac-proxy-web/0.log"
Jul 25 02:22:24.904673 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.904648    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/kube-rbac-proxy/0.log"
Jul 25 02:22:24.927995 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.927966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/kube-rbac-proxy-thanos/0.log"
Jul 25 02:22:24.949805 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.949714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d5d4251c-649d-4d28-80d9-f9e10234374a/init-config-reloader/0.log"
Jul 25 02:22:24.984451 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.984422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l2rzw_0f4193df-9ac4-4ac4-abe8-691c6a59aa11/prometheus-operator/0.log"
Jul 25 02:22:24.999289 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:24.999262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l2rzw_0f4193df-9ac4-4ac4-abe8-691c6a59aa11/kube-rbac-proxy/0.log"
Jul 25 02:22:25.022814 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.022785    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-tr6vq_281ef643-efe8-4437-8e50-94c11e8e9d61/prometheus-operator-admission-webhook/0.log"
Jul 25 02:22:25.056323 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.056296    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b66d4556b-krm8w_27665c84-9499-49f7-ab0b-45f1f214702a/telemeter-client/0.log"
Jul 25 02:22:25.094842 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.094810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b66d4556b-krm8w_27665c84-9499-49f7-ab0b-45f1f214702a/reload/0.log"
Jul 25 02:22:25.116024 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.115996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b66d4556b-krm8w_27665c84-9499-49f7-ab0b-45f1f214702a/kube-rbac-proxy/0.log"
Jul 25 02:22:25.158624 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.158593    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/thanos-query/0.log"
Jul 25 02:22:25.180020 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.179994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/kube-rbac-proxy-web/0.log"
Jul 25 02:22:25.205483 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.205409    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/kube-rbac-proxy/0.log"
Jul 25 02:22:25.224385 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.224354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/prom-label-proxy/0.log"
Jul 25 02:22:25.246203 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.246169    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/kube-rbac-proxy-rules/0.log"
Jul 25 02:22:25.265666 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:25.265637    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8bd9446-mwpvs_84de3649-044b-4723-83ae-c6c4bc5df2ba/kube-rbac-proxy-metrics/0.log"
Jul 25 02:22:28.093486 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093449    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"]
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093854    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093866    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093876    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093882    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093892    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093898    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093905    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d37753e-6228-4219-a99f-4b923a1fbb2e" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093911    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d37753e-6228-4219-a99f-4b923a1fbb2e" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093918    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093924    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093933    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359db05b-7af9-467d-8988-8fbe27468b1c" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093938    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="359db05b-7af9-467d-8988-8fbe27468b1c" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093944    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093949    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093964    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9c952-7889-496a-8617-766e79956b4f" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093969    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9c952-7889-496a-8617-766e79956b4f" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093977    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4881fd20-df14-42b9-a025-3793876ad4b6" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.093982    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4881fd20-df14-42b9-a025-3793876ad4b6" containerName="payload-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094040    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d37753e-6228-4219-a99f-4b923a1fbb2e" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="359db05b-7af9-467d-8988-8fbe27468b1c" containerName="payload-pre-processing"
Jul 25 02:22:28.094044 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094054    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd606b8a-cdc9-4668-a400-01672c1b0f4c" containerName="payload-processing"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094062    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a083b4ac-09b0-4d78-a528-0f04459ed49d" containerName="istio-proxy"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094068    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094073    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2169b0f-0488-4a6c-8f62-ceae4f7202b0" containerName="payload-processing"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094080    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094085    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46c358b-1374-497e-a655-0b9a1a0c208a" containerName="istio-proxy"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094090    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9c952-7889-496a-8617-766e79956b4f" containerName="payload-pre-processing"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094096    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb069a2a-6bb1-490e-866e-7323311c7ff4" containerName="istio-proxy"
Jul 25 02:22:28.094783 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.094101    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4881fd20-df14-42b9-a025-3793876ad4b6" containerName="payload-processing"
Jul 25 02:22:28.098704 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.098681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.100935 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.100908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m4dqv\"/\"default-dockercfg-nfx4k\""
Jul 25 02:22:28.101087 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.100987    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dqv\"/\"kube-root-ca.crt\""
Jul 25 02:22:28.101263 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.101249    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dqv\"/\"openshift-service-ca.crt\""
Jul 25 02:22:28.109052 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.109029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"]
Jul 25 02:22:28.178394 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.178361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-lib-modules\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.178600 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.178403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-sys\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.178600 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.178427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-proc\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.178600 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.178561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hscw\" (UniqueName: \"kubernetes.io/projected/60052776-4e0a-4a0d-af3f-8dc91fb3831f-kube-api-access-6hscw\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.178712 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.178602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-podres\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279456 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-podres\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-lib-modules\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-sys\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-proc\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hscw\" (UniqueName: \"kubernetes.io/projected/60052776-4e0a-4a0d-af3f-8dc91fb3831f-kube-api-access-6hscw\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279679 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-podres\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279873 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-lib-modules\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279873 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-proc\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.279873 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.279705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60052776-4e0a-4a0d-af3f-8dc91fb3831f-sys\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.290240 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.290214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hscw\" (UniqueName: \"kubernetes.io/projected/60052776-4e0a-4a0d-af3f-8dc91fb3831f-kube-api-access-6hscw\") pod \"perf-node-gather-daemonset-7v4sm\" (UID: \"60052776-4e0a-4a0d-af3f-8dc91fb3831f\") " pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.409977 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.409890    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:28.548397 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.548369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"]
Jul 25 02:22:28.551056 ip-10-0-130-23 kubenswrapper[2565]: W0725 02:22:28.551024    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60052776_4e0a_4a0d_af3f_8dc91fb3831f.slice/crio-621a8cc8c1c4ec44fb722efc9ae2d410ac1900eb817988515decbaa584de2c3e WatchSource:0}: Error finding container 621a8cc8c1c4ec44fb722efc9ae2d410ac1900eb817988515decbaa584de2c3e: Status 404 returned error can't find the container with id 621a8cc8c1c4ec44fb722efc9ae2d410ac1900eb817988515decbaa584de2c3e
Jul 25 02:22:28.669900 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:28.669813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm" event={"ID":"60052776-4e0a-4a0d-af3f-8dc91fb3831f","Type":"ContainerStarted","Data":"621a8cc8c1c4ec44fb722efc9ae2d410ac1900eb817988515decbaa584de2c3e"}
Jul 25 02:22:29.545447 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.545418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8xpqk_a3c7dab3-7e83-42dc-8f72-907cb44e2704/dns/0.log"
Jul 25 02:22:29.566397 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.566370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8xpqk_a3c7dab3-7e83-42dc-8f72-907cb44e2704/kube-rbac-proxy/0.log"
Jul 25 02:22:29.676032 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.675998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm" event={"ID":"60052776-4e0a-4a0d-af3f-8dc91fb3831f","Type":"ContainerStarted","Data":"410b43cbb4d72233add5640ddfaabd63f61f0a776849d5437efdd3472c5b9f9f"}
Jul 25 02:22:29.676232 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.676150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:29.690937 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.690889    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm" podStartSLOduration=1.690875052 podStartE2EDuration="1.690875052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 02:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:22:29.688183613 +0000 UTC m=+4268.590828624" watchObservedRunningTime="2026-07-25 02:22:29.690875052 +0000 UTC m=+4268.593520064"
Jul 25 02:22:29.698806 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:29.698786    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnx62_5fb6f6f8-a2ba-4b12-89c1-8f0f0cb70291/dns-node-resolver/0.log"
Jul 25 02:22:30.247086 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:30.247057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dqkjz_dd6f88d7-a032-4f0e-a320-a7fac3cc187b/node-ca/0.log"
Jul 25 02:22:31.163419 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:31.163386    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv_e11fcafe-d3c9-4c60-8a23-74bb6eb23a29/istio-proxy/0.log"
Jul 25 02:22:31.419526 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:31.419423    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mc62z_6968c23f-97df-43b0-a9c2-1953b2bd9461/discovery/0.log"
Jul 25 02:22:31.491388 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:31.491350    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/0.log"
Jul 25 02:22:31.544463 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:31.544429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/1.log"
Jul 25 02:22:31.587286 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:31.587254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-79szl_61ee4fde-e70b-4448-85c3-0492b6c382cb/payload-pre-processing/0.log"
Jul 25 02:22:32.434660 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:32.434630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sghr6_bbe5ad57-a208-461c-87f6-f8df4c0a2d20/serve-healthcheck-canary/0.log"
Jul 25 02:22:33.105822 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:33.105784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9npk_11889849-9aca-4581-9ff2-c3e7174ff9a1/kube-rbac-proxy/0.log"
Jul 25 02:22:33.125400 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:33.125372    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9npk_11889849-9aca-4581-9ff2-c3e7174ff9a1/exporter/0.log"
Jul 25 02:22:33.145610 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:33.145588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9npk_11889849-9aca-4581-9ff2-c3e7174ff9a1/extractor/0.log"
Jul 25 02:22:35.693179 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:35.693145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m4dqv/perf-node-gather-daemonset-7v4sm"
Jul 25 02:22:35.705974 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:35.705948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cd5dc4b6d-wt6vf_76b4860d-8947-42bb-8492-b48e149c8179/manager/0.log"
Jul 25 02:22:36.020308 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:36.020223    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9844cf678-qvbnc_8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb/manager/0.log"
Jul 25 02:22:36.038272 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:36.038250    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9844cf678-qvbnc_8bedb8e9-5318-4f7f-ac9f-9c49f396d2cb/copy-manifests/0.log"
Jul 25 02:22:37.344933 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:37.344876    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66889bf7cd-cw9k8_7fdc2afc-790e-4ca4-8c13-a90a81d277d5/manager/0.log"
Jul 25 02:22:37.909857 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:37.909765    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv_e11fcafe-d3c9-4c60-8a23-74bb6eb23a29/istio-proxy/0.log"
Jul 25 02:22:38.171317 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:38.171229    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mc62z_6968c23f-97df-43b0-a9c2-1953b2bd9461/discovery/0.log"
Jul 25 02:22:38.229658 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:38.229624    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/0.log"
Jul 25 02:22:38.282831 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:38.282803    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/1.log"
Jul 25 02:22:38.312363 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:38.312330    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-79szl_61ee4fde-e70b-4448-85c3-0492b6c382cb/payload-pre-processing/0.log"
Jul 25 02:22:39.740171 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:39.740072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwx4gv_e11fcafe-d3c9-4c60-8a23-74bb6eb23a29/istio-proxy/0.log"
Jul 25 02:22:39.997207 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:39.997129    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mc62z_6968c23f-97df-43b0-a9c2-1953b2bd9461/discovery/0.log"
Jul 25 02:22:40.053575 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:40.053545    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/0.log"
Jul 25 02:22:40.107986 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:40.107954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s7c86_ad96367b-ec55-4b0a-86cc-587672b0545d/istio-proxy/1.log"
Jul 25 02:22:40.139335 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:40.139301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-79szl_61ee4fde-e70b-4448-85c3-0492b6c382cb/payload-pre-processing/0.log"
Jul 25 02:22:43.652458 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.652431    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/kube-multus-additional-cni-plugins/0.log"
Jul 25 02:22:43.674033 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.674002    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/egress-router-binary-copy/0.log"
Jul 25 02:22:43.694177 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.694149    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/cni-plugins/0.log"
Jul 25 02:22:43.713492 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.713462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/bond-cni-plugin/0.log"
Jul 25 02:22:43.732876 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.732851    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/routeoverride-cni/0.log"
Jul 25 02:22:43.751665 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.751636    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/whereabouts-cni-bincopy/0.log"
Jul 25 02:22:43.775103 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:43.775062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zv_131387d4-83e4-45bf-8339-91815f154788/whereabouts-cni/0.log"
Jul 25 02:22:44.127494 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:44.127464    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b88r8_1190a043-2288-430b-9c28-9f203e6a1070/kube-multus/0.log"
Jul 25 02:22:44.260924 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:44.260846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s4tph_9f47eaa5-0859-40b6-a4df-3b2c764a6577/network-metrics-daemon/0.log"
Jul 25 02:22:44.276153 ip-10-0-130-23 kubenswrapper[2565]: I0725 02:22:44.276118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s4tph_9f47eaa5-0859-40b6-a4df-3b2c764a6577/kube-rbac-proxy/0.log"